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TUESDAY, SEPTEMBER 19, 2013 

House of Representatives, 
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Committee on Science, Space, and Technology, 

Washington, D.C. 
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2318 of the Rayburn House Office Building, Hon. Paul Broun 
[Chairman of the Subcommittee on Oversight] presiding. 
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U.S. HOUSE OF REPRESENTATIVES 
COMMITTEE ON SCIENCE, SPACE, AND TECHNOLOGY 
SUBCOMMITTEE ON OVERSIGHT 
AND 

SUBCOMMITTEE ON ENVIRONMENT 

HEARING CHARTER 


Dysfunction in Management of Weather and Climate Satellites 


Thursday, September 1 9, 20 1 3 
10:00AM- 12:00PM 
23 1 8 Rayburn House Office Building 


Purpose 

On Thursday, September 19th, the Subcommittees on Oversight and Environment will 
hold a joint hearing to conduct on-going oversight of the nation’s weather and climate satellite 
programs. The U.S. Government Accountability Office (GAO) has identified a high probability 
in degraded weather satellite coverage starting as early as next year, and has designated this data 
gap as a new high-risk area in a report earlier this year. 1 Given this potential gap in weather 
satellite coverage, the hearing will address questions about the Administration’s priorities in 
funding weather satellites and research as compared to climate change-monitoring satellites and 
research. 

WITNESS LIST 


• Mr. David Powner, Director, Information Technology Management Issues, U.S. 
Government Accountability Office. 

• Ms. Mary Kicza, Assistant Administrator, Satellite and Information Services, National 
Oceanic and Atmospheric Administration (NOAA). 

• Mr. Marcus Watkins, Director, Joint Agency Satellite Division, National Aeronautics 
and Space Administration (NASA). 

Background 

Over the last decade, the Committee on Science, Space, and Technology has monitored 
the development of the Joint Polar Satellite System and its predecessor program, the National 
Polar-orbiting Operational Environmental Satellite System, which provide vital data to weather 


1 GAO, “High-Risk Series: An Update,” GAO-13-283, February 2013, p.21, available at: 
http://www.gao.gov/assets/660/652133.pdf. 
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forecasters. 2 3 However, extreme weather events in the United States during the past year, like 
Hurricane Sandy and tornados in Oklahoma and elsewhere, have raised questions about whether 
America’s weather monitoring and forecasting ability is as reliable as compared to other 
countries. 2 

Fueling further concerns about America’s weather monitoring and forecasting ability is a 
potential gap in satellite coverage. NOAA’s polar-orbiting and geostationary weather satellites, 
the Joint Polar Satellite System (JPSS) and Geostationary Operational Environmental Satellite 
(GOES) system respectively, are a fundamental aspect of our nation’s forecasting abilities. For 
example, in 2010, data from polar-orbiting satellites helped meteorologists predict the arrival of 
“Snowmageddon” five days in advance, and forecasts of Hurricane Sandy’s track might have 
been hundreds of miles off without information from polar-orbiting satellites, according to a 
study by the European Centre for Medium-Range Weather Forecasts. 4 ’ 5 * Unfortunately, 
development of the next-generation weather satellite has been plagued with problems. The most 
troubling consequence of these problems is the prospect of coverage and data gaps. Citing 
ongoing concerns about the potential gaps and their impact, GAO reports: 

“According to NOAA program officials, a satellite data gap would result in less accurate 
and timely weather forecasts and warnings of extreme events, such as hurricanes, storm 
surges and floods. Such degradation in forecasts and warnings would place lives, 
property, and our nation’s critical infrastructures in danger.” 

Costly delays make it more likely that the new satellites won’t be ready before the 
existing satellites reach the end of their projected operational life. JPSS is facing a gap of 17 to 
53 months, and funding shortfalls in Fiscal Year (FY) 2012 and FY 2013 forced GOES-R work 
to be deferred, increasing the chances of a two-imager gap. 7 ' 8 9 An update on the GOES-R 
program from NOAA staff last month stated, “there would be at least a 3-month schedule slip in 
GOES-R due to sequestration.” 

Overemphasis on Climate Science Endangering Weather Forecasting? 

By contrast, funding for climate science satellites and research at NASA has increased by 
over 40 percent since 2008. The Administration’s FY 2014 budget proposal included $1.8 
billion for earth science compared to $1.2 billion received in FY 2008/ NASA Administrator 


2 Committee Oversight of NOAA JPSS Weather Satellite Program, available at: 

http://science.house.gov/comrnittee-oversight-noaa-jpss-weather-satellite-progr am-previously-npoess#overlay- 
contexl=letter/committee-oversight-noaa-jpss-weather-satellite-program-previously-npoess. 

3 Brian Montopoli, “Can We Get Better at Predicting Tornadoes?" CBS News, May 22, 2013, available at: 
http://www.cbsnews.com/8301-201_162-57585580/can-we-get-better-at-predicting-tornadoes. 

4 NOAA, Suomi NPP: Improving U.S. Weather Forecast Accuracy from Space, December 3, 2012, available at: 
http://www.nesdis.noaa.gov/npp_launch.htrnl. 

5 European Centre for Medium-Range Weather Forecasts, “Annual Report: 2012," p.5, available at: 

http://www.ecmwf.int/publications/annual_report/2012/pdf/Annual-report-2012.pdf. 

8 GAO-13-283, February 2013, p. 70. 

7 GAO-13-283, February 2013, p.22. 

8 NOAA NESDIS Independent Review Team Report, July 20, 2012, p.24 & p.27, available at: 

http://science.house.gov/sites/republieans.science.house.gov/riles/documents/NESDIS_lRT_Final_Report.pdf, 

9 NASA annual budgets, available at: http://www.nasa.gOv/ncws/budget/index.html#.UjdB_z9YRws. 
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Charles Bolden has dubbed 2014 “the year of Earth Science” at NASA. 10 As part of the 
Administration’s FY 2014 budget request, responsibility for sustained climate measurements 
from the Total Solar Irradiance Sensor (TS1S), the Clouds and Earth’s Radiant Energy System 
(CERES) and the limb soundings from the Ozone Mapping and Profiler Suite (OMPS-L) have 
been transferred from NOAA’s JPSS program to NASA. NASA's FY 2014 budget request 
includes a one-time $40 million increase to pay for the climate sensors, but Dr. Michael Freilich, 
Director of NASA’s Earth Science Division, has expressed concerns about the long term impact 
of adding these sensor requirements to NASA without also providing adequate funding. 1 1 
Thirteen different federal agencies fund $2.5 billion annually in climate science research. This 
hearing will consider the Administration’s relative priorities and funding for weather monitoring, 
forecasts, and research compared to climate monitoring, forecasts, and research. 

National Polar-orbiting Operational Environmental Satellite System 

In the 1960s, the United States began operating two polar-orbiting meteorological 
satellite systems: one managed by NOAA and another by the Air Force. Polar-orbiting satellites 
transverse the globe from pole to pole, with each orbit defined by the time of day they pass over 
the equator: early morning, late morning, and afternoon. Unlike geostationary weather satellites, 
which offer persistent coverage over an area, each polar-orbiting satellite makes approximately 
14 orbits per day and is able to view the entire earth’s surface twice per day. 

In 1994, as part of the Clinton-Gore Administration’s Reinventing Government initiative, 
a Presidential Decision Directive required NOAA and the Department of Defense (DOD) to 
merge the civilian and military polar-orbiting satellite systems into one program, the National 
Polar-orbiting Operational Environmental Satellite System (NPOESS). To manage the program, 
DOD, NOAA and NASA formed a tri-agency Integrated Program Office. Overall responsibility 
for the management of the system and satellite operations was assigned to NOAA. The DOD 
was responsible for acquisition of the sensors, bus and launch vehicle, while NASA was 
responsible for facilitating the development and incorporation of new technologies. 12 

By 2009, the life-cycle estimate had grown to at least $14.9 billion for four new satellites, 
the first of which was projected to launch in 2014. In June 2009, an Independent Review Team 
(IRT) determined that the NPOESS program had an extremely low probability of success. 11 At a 
Science and Technology Committee hearing that month, witnesses testified that program 
leadership had deteriorated to the point that only White House intervention could save NPOESS. 


10 Southern California Public Radio, “NASA to focus on Earth in 2014,” August 19, 2013, available at: 
http://www.scpr.org/news/201 3/08/1 9/3 8745/nasa-to-focus-on-earth-in-20 1 4-photos. 

1 1 Marcia S. Smith, “NOAA Reduces JPSS Costs by $1.6 Billion - How Did They Do ft?” Space Policy Online , 
April 29, 2013, available at: http://www.spacepolicyonline.com/news/noaa-reduces-jpss-costs-by-l-6-billion-how- 
did-they-do-it. 

12 GAO, “Polar-Orbiting Environmental Satellites: Changing Requirements, Technical Issues, and Looming Data 
Gaps Require Focused Attention,” GAO-12-604, June 2012, p.12, available at: 
http://www.gao.gov/assets/600/591643.pdf. 

13 NPOESS Independent Review Team Report, June 29, 2009, available at: 

ftp://140.90.120.98/JPSS%20Docs/NPOESS%20JPSS%20Documents%20for%20Transition/Reviews/NPOESS%20 
IRT/NPOESS%20IRT%20Final%20Repo rt%20vFinal.pdf. 
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Joint Polar Satellite System 

In February 2010, the Office of Science and Technology Policy announced that the 
program would be split, with NOAA and the DOD creating their own programs, establishing 
requirements, and transferring existing NPOESS contracts to new programs. Satellites flying in 
orbits to collect early-morning observations would be developed and launched by DOD, while 
NOAA’s Joint Polar Satellite System would collect observations in the afternoon orbit. The late 
morning orbit was completely abandoned to the European Organization for the Exploitation of 
Meteorological Satellites (EUMETSAT) Polar System. 14 


In 2010, NOAA estimated that the life cycle costs of the JPSS program would be 
approximately $ 1 1 .9 billion. Though data monitoring requirements for the program had not 
changed, NOAA’s JPSS program office made plans to remove key requirements to keep the 
program within the prescribed budget. Meanwhile, DOD decided to terminate its program and 
reassess its requirements. 15 

The following table from GAO 16 compares the planned costs, schedule and scope of the 
three programs over time. 


Figure 1: Temporal Comparison of NPOESS and JPSS 


Key 

area 

NPOESS 

program before It 
was restructured 
(as of May 2006} 

NPOESS program after 
K was restructured (as 
or June 2006) 

NPOESS program prior 
to being disbanded (as 
at February 2010} 

JPSS program (as of 
May 2010) 

JPSS program (as 
of Jun* 2012) 

Life 

cycle 

range 

1995 2020 

1995-2026 

1995-2026 

1995-2024 

1995-2028 

Estimate 
life cycle 
cost 

$8.4 billion 

$12.5 billion 

SI 3.95+ billion* 

$1 1 9 billion (which 
includes about $2.9 
billion spent through 
fiscal year 20 1 0 on 
NPOESS) 

$12.9 billion (which 
includes about $3.3 
billion spent through 
fiscal year 201 1 oh 
NPOESS and JPSS) 

Number 

of 

satellites 

6 (in addition to 
S-NPP) 

4 (in addition to S-NPP) 

4 (in addition to S-NPP) 

2 (in addition to S-NPP) 

2 (in addition to 

S-NPP) 

Number 
of orbits 

3 (early morning, 
mkl morning, 
afternoon) 

2 (early morning and 
afternoon; would rety on 
European satellites tor 
mklmomiog orbit data) 

2 (early morning and 
afternoon; would rely on 
European sate Hites for 
mldmoming orbit data) 

1 (afternoon orbit) 

(DOD and European 
satellites would provide 
early and mldmoming 
orbit, respectively) 

1 (afternoon orbit) 

(DOD and European 
satellites would 
provide earty and 
mldmoming orbit, 
respectively) 

Launch 

schedule 

S-NPP by October 
2006 

First NPOESS 
(Cl) by November 
2009 

Second NPOESS 
(C2) by June 2011 

S-NPP by January 2010 
Cl by January 2013 

C2 by January 2016 

03 toy January 20 in 

C4 by January 2020 

S-NPP no earlier man 
September 201 1 

Cl by March 2014 

C2 by May 2016 

C3 by January 2018 

C4 by January 2020 

s-npp — no earner than 
September 201 1 

JPSS-1 available in 2015 

JPSS-2 available in 2018 

S-NPP — successfully 
launched In October 
2011 

JPSS-1 by March 

2017 

JPSS-2 by December 
2022 

Number 

1 1 sensors and 2 

S-NPP: 4 sensors 

S-NPP: 5 sensors 

S-NPP: S sensors 

S-NPP: 5 sensors 

of 

user services 

C l; 6 sensors 

Cl: 7 sensors” 

JPSS 1 : 5 sensors' 

JPSS-1; 5 sensors* 



C2: 2 sensors 

C2: 2 sensors 

JPSS-2. 5 sensors 

JPSS-2: 5 sensors 



C3 6 sensors 

C3: 6 sensors 





C4: 2 sensors 

C4: 2 sensors 




Sai trom 0*0 nape a* NOAA. OOO. aid Ink fen* hju 

•Although (tie program baseline or 33 $13.95 billion in February 2010, we estimated in June 2009 tnat 
mis cost could grow by about Xt billion. In addition, officials from tne Executive Office of the President 
staled that they reviewed lire cycle cost estimates from DOD and me NPOESS program office of 
$15.1 biHron and $16.45 billion, respectively. 

“in May 2008. me NPOESS Executive Committee approved an additional sensor — the Total and 
Spectral Solar irradiance Sensor — for tne Cl satellite. 

c The five sensors are ATM3, the Clouds and me Earth's Radiant Energy System (CERES). CrIS. 
OMPS. and VHRS. NOAA also committed to finding an alternative spacecraft and launch 
accommodation for me Total and Spectral Solar Irradiance Sensor, me Advanced Data Collection 
System, and tne Search and Rescue Sate Site-Aided Tracking System. 


14 GAO-12-604, June 2012, p.l. 

15 GAO-12-604, June 2012, p.!2. 

16 GAO, “Polar Weather Satellites: NOAA identified Ways to Mitigate Data Gaps, but Contingency Plans and 
Schedules Require Further Action,” GAO-13-676, September 2013, p.l 5. 
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By 201 1, NOAA and NASA had established separate but co-located JPSS program 
offices, each with different roles and responsibilities. NOAA is responsible for programmatic 
activities related to the JPSS satellite development, including managing requirements, budgets 
and interactions with satellite data users. NASA is responsible for the development and 
integration of sensors, satellites and ground systems. 

The joint NASA and NOAA JPSS team launched the Suomi National Polar-orbiting 
Partnership (S-NPP) satellite in October 2011, the first of a new generation of satellites. S-NPP 
will collect remotely-sensed land, ocean and atmospheric data during the afternoon orbit. 

NOAA and NASA officials are currently working to complete the calibration and validation of 
the satellite’s sensors by October 2013, though according to the GAO, some issues have been 
encountered during this process that may lead to delays in developing satellite products. (More 
on this below.) 

JPSS Issues 

Dysfunctional Oversight of Satellite Programs 

According to an Independent Review Team chartered by NOAA/NESDIS to conduct an 
assessment of the total NOAA satellite enterprise in 2012, Department of Commerce (DOC) and 
NOAA oversight of the satellite programs is "dysfunctional.” 7 The IRT judged that 
micromanagement, lack of trust, and poor communication have made the oversight and decision 
making process cumbersome and inefficient. 18 

Governance Model is Inefficient 

Unlike the GOES-R governance model, which integrates NOAA and NASA elements 
into one structure, the JPSS model is made up of two parallel structures. This more complicated 
model causes confusion, creates inefficiencies, increases costs and decreases the probability of 
mission success. 19 

Cost Cutting Measures Diminish Capabilities 

From January to December 201 1, NOAA conducted an independent cost estimate and 
validated that the cost of the full set of JPSS functions from FY 2012 through FY 2028 would be 
$1 1.3 billion. After adding sunk costs of $3.3 billion, the program’s life cycle estimate totaled 
$14.6 billion. This amount is $2.7 billion higher than the $1 1.9 billion estimate for JPSS after 
the NOAA and DOD requirements were divided in 20 1 0. The increase is attributed to a 
program extension of four years, the addition of free flyers,* 0 cost growth associated with 
transitioning contracts from DOD to NOAA, and the program’s decision to delay work because 


17 NOAA NESDIS Independent Review Team Report, July 20, 2012, p.l 1. 

13 NOAA NESDIS Independent Review Team Report, Juiy 20, 2012, p.12. 

19 NOAA NESDIS Independent Review Team Report, Juiy 20, 2012, p. 16. 

30 Free flyers are separate spacecraft intended to integrate and launch key instruments that could not be 

accommodated on the JPSS satellites. 
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of budget uncertainties. 21 As part of its FY 2013 budget, NOAA revised the program’s scope to 
focus on weather in order to bring the total costs down to $ 1 2.9 billion, and more recently, 
NOAA made additional changes to bring the overall cost back down to $1 1.3 billion,'" It bears 
noting that cuts also diminish overall program capabilities and can delay data delivery times to 
customers. 

S-NPP Not Yet Fully Operational Due to Delays 

The S-NPP is not yet fully operational due to delays in validating the readiness and utility 
of data products and issues with the JPSS ground systems schedules. The JPSS program had 
originally intended to be able to deliver 76 precise data products 18-24 months after launching S- 
NPP. However, only 18 products will be validated for operational use by September 2013, 
another 35 by September 2014, and another one by September 2015, two years later than 
planned. 23 The remaining products either do not need to be validated, do not have estimated 
validation dates, or are being scrapped. GAO also determined that NOAA has failed to directly 
track whether key users are using S-NPP products or if the products meet users’ needs. 24 Lastly, 
though instrument and spacecraft development is on track, scheduling issues on the JPSS ground 
system could further delay major program milestones. 25 

JPSS' Integrated Master Schedule is Incomplete 

The JPSS program office’s June 2013 preliminary integrated master schedule (IMS) lacks 
the necessary information needed to effectively monitor progress, manage dependencies and 
accurately forecast completion and launch, according to GAO. Also, several of the supporting 
schedules such as the ground and spacecraft schedule, contain quality weaknesses which degrade 
the overall reliability of the IMS. GAO scheduling guidance offers ten best practices to develop 
high-quality, reliable schedules. 26 

No Comprehensive Contingency Plans to Address Gap Mitigation Shortfalls 

When the NPOESS program disbanded in 2010. NOAA anticipated launching satellites 
in 2015 and 2018. Leading up to the launch of S-NPP, NOAA made changes to ensure that the 
program stayed on schedule. In doing so, the launch dates for JPSS-1 and JPSS-2 have been 
pushed back to March 2017 and December 2022, respectively. This would lead to a potential 
gap in polar weather satellite coverage of between 17 months to three years (see Figure 2t . 27 In 
October 2012, NOAA established a mitigation plan to address the probable gap in polar 
afternoon satellite data. The plan identifies alternatives for mitigating the risk of a coverage gap 
and lists the technical, programmatic and management actions necessary to implement the 
various options. NOAA has not, however, created a complementary, comprehensive 


21 GAO-12-604, June 2012, p.13. 

22 Ibid. 

23 GAO-13-676, September 2013, p.20. 

24 GAO-13-676, September 2013, p.22. 

25 GAO-13-676, September 2013, p.23. 

26 GAO, “Schedule Assessment Guide: Best Practices for Project Schedules,” GAO-12-120G, May 2012, available 
at: http://www.gao.gov/assels/600/591240, pdf. 

27 GAO- 12-604, June 2012, p.26. 
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contingency plan that integrates select strategies and addresses key elements to control the 
impact of risks should they occur . 28 Until NOAA does so, it may not be prepared to mitigate the 
looming coverage gap. according to GAOr 9 


Figure 2: Potential Gaps in Polar Satellite Data in the Afternoon Orbit 30 



Free Flyers 

One of the largest uncertainties associated with the current JPSS program is what NOAA 
plans to do with free flyers. Free flyers are separate spacecraft intended to integrate and launch 
key instruments that could not be accommodated on the JPSS satellites. Once a part of the JPSS 
program, NOAA has now established a separate and new Polar Free Flyer program , 31 but it is 
uncertain what the exact manifests will be, what the cost estimates will be for the bus or ride 
share contribution, what the sensor development or launch schedule will be, and what launch 
vehicle NOAA will use or what mission they will share. Until the free flyer program is further 
defined, the uncertainty associated with it could complicate the definition of requirements for the 
JPSS program. 

Geostationary Satellite System 

In addition to polar-orbiting satellites, NOAA also operates Geostationary Observational 
Environmental Satellites (GOES). NOAA’s GOES satellites operate from a geosynchronous 


28 NOAA NESDIS Independent Review Team Report, July 20, 2012, p.21. 

29 GAO-13-676, September 2013, p.4i. 

30 GAO-13-676, September 2013, p.18. 

31 GAO-13-676, September 2013, p.48. 
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orbit 22,300 miles above the Earth, which means they orbit the equatorial plane of the Earth at a 
speed matching the Earth’s rotation. This vantage point allows the satellites to essentially 
‘hover’ continuously over one position on the surface of the earth, and serve as a fixed eye on the 
continental United States with limited coverage of the polar regions. 

The GOES system operated by NOAA utilizes two satellites - one fixed on the eastern 
United States and the other on the western United States. At any given time, the GOES system 
also includes a third on-orbit ‘spare’ called into duty either as an emergency back-up to the 
primary satellites, or naturally sequenced into operations once an older satellite’s service has 
degraded. 

The next-generation of the GOES satellites, known as the GOES-R, is under 
development. GOES-R is expected to significantly improve weather data and will be able to 
transmit that data at faster rates more frequently. Both improvements will enhance the quality 
and timeliness of information to the user. 

In the original 2006 plan for the GOES-R program, NOAA estimated the life-cycle cost 
to be $6.2 billion for the period of 2007-2020 and an expected launch date in 2012. This would 
allow for the purchase of four satellites and included the development of two new major 
instruments, the Advanced Baseline Imager (ABI) and the Hyperspcctral Environmental Suite 
(HES), as well as upgraded space weather sensors. 32 By September 2006, however, costs were 
escalating to a reported $1 1.4 billion. To reduce overall costs, NOAA significantly de-scoped 
the program by eliminating two of the four planned satellites and by cancelling the plans for the 
HES. The agency estimated the new program would cost $7 billion and would launch in 
December 2014.” In May 2007 (only 8 months later), NOAA changed its estimated life cycle 
cost to $7.67 billion. According to GAO, the ABI instrument - designed to provide imagery and 
radiometric information of the Earth’s surface, atmosphere and cloud cover - experienced 
technical problems. In an effort to manage risks, significant capabilities were removed from the 
ABI, resulting in an instrument that is significantly less capable than what was originally 
planned. 

Life cycle cost estimates for the GOES-R series now stand at $10.9 billion through 2036 
— an increase of $3.2 billion over the estimate for a two satellite system in May 2007. The first 
of the series is scheduled to launch in October 2015, though NOAA program officials have 
recently acknowledged that the launch date may be delayed by six months. 34-35 

The following table demonstrates key changes to the program since August 2006: 


32 GAO, “Geostationary Weather Satellites: Design Progress Made, But Schedule Uncertainty Needs to be 
Addressed,” GAO-12-576. June 2012, p.8, available at: http://www.gao.gov/assets/600/591914.pdf. 

33 Ibid. 

34 Ibid. 

35 GAO, “Geostationary Weather Satellites: Progress Made, but Weaknesses in Scheduling, Contingency Planning, 
and Communication with Users Need to be Addressed,” GAO-13-597, September 2013, p.25. 


8 



11 


Figure 3: Key Changes to the GOES-R Program 36 




August 2006 
(baseline program) 

September 2008 

November 2007 

February 2011 

Number of 
satellites 

4 

2 

2 

4 

Instruments or 

instrument 

changes 

. Advanced Baseline Imager 
. Geostationary Lightning Mapper 
« Magnetometer 

• Space Environmental In-Situ Suite 

• Solar Imaging Suite (which 
included the Solar Ultraviolet 
Imager, and Extreme Ultraviolet/X- 
Ray trradiance Sensor) 

• Hyperspectra! Environmental Suite 

• Advanced Baseline Imager 

. Geostationary Lightning Mapper 

• Magnetometer 

• Space Environmental In-Situ Suite 
« Solar Ultraviolet Imager 

• Extreme Uitravioiet/X-Ray 
Irradiance Sensor 

No change 

No change 

Number of 

satellite 

products 

81 

68 

34 baseline 

34 optional 

34 baseline 

31 optional 

Life cycle cost 
estimate (in 
then- year 
dollars) 

56.2 billion — $1 1 .4 billion (through 
2034) 

$7 billion (through 2028) 

$7.67 billion 
(through 2028) 

$10.9 billion 
(through 2036) a 

Estimated 
launch dates for 
GOES-R and S 

GOES-R: September 2012 

GOES-S; April 2014 

GOES-R: September 2012 

GOES-S: April 2014 

GOES-R: 
December 2014 
GOES-S: 

April 2016 

GOES-R: 

October 2015 
GOES-S: 

February 2017 

Source GAO onotysa at NOAA data 

J Based on NOAA'» fiscal year 2012 budget submission. $7.64 billion of this cost estimate was for the 
first two satellites in the series, GOES-R and GOES-S. The cost for the remaining two satellites — 
GOES-T and GOES-U — was estimated at $3.22 billion. 


GOES-R Issues 

Reporting on Reserves Is Not Sufficiently Detailed or Transparent 

Senior level management are not regularly briefed on the status of program reserve 
funding. GAO has previously repotted that, "in order to oversee GOES-R contingency funding, 
senior managers should have insight into the amount of reserves set aside for each satellite in the 
program and detailed information on how reserves are being used...” 37 According to GAO, 
without regular, detailed briefings on reserve funding and budgeting information, executives will 
not be able to make the most optimal, well-informed decisions. 

Missed Milestones and Scheduling Deficiencies Increase Likelihood of a Delayed Launch 

Successive missed milestones and delays will allow the program less time to respond to 
unforeseen problems as the launch date approaches. Figure 4 highlights key milestones and the 
extent of delays. Though NOAA has adopted some GAO recommendations on managing 
program schedules, 38 issues remain. 37 Program schedules provide a road map for systematic 
execution and a means to monitor progress and identify potential problems. Without more 
reliable schedule planning, program milestones will likely continue to be missed. 


36 GAO-13-597, September 2013, p.10. 

37 GAO-13-597, September 2013, p.22. 

35 GAO-12-576, June 2012, p.23. 

39 GAO-13-597, September 2013, Pp.28-29. 
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Figure 4: GOES-R Program Delays 40 


Program milestone 

Date planned 
(as of Apr 2012) 

Date completed or 

planned 

(as of Mar 2013) 

Delay 

Mission operations review 

January 2013 

January 2014 

12 months 0 

End-to-end test #1 

February 2014 

May 2014 

3 months 

End-to-end test #2 

May 2014 

August 2014 

3 months 

End-to-end test #3 

August 2014 

December 2014 

4 months 

Flight operations review 

September 2014 

January 2015 

4 months 

End-to-end test #4 

December 2014 

March 2015 

3 months 

End-to-end test #5 

July 2015 

July 2015 

No change 

Source: GAO analysis of NOAA data. 

Nota: 0 Program officials stated that they had erroneously scheduled the mission operations review too soon, and moved the date by 9 
months to better reflect when the review was needed. Therefore, only 3 of the 12 months were attributable to o detoy. 


Continued Technical Issues Could Cause Further Delays 

Technical issues on flight and ground projects could cause further delays. For instance, 
an electronics board in the Geostationary Lightning Mapper (GLM) emitted unexpectedly high 
levels of radiation during testing. If this problem cannot be fixed, the instrument’s performance 
would be degraded. Program officials have considered excluding the GLM from the first GOES 
satellite, which would significantly reduce the satellite’s functionality. The GLM is intended to 
continuously monitor total lightning activity day and night over much of the western hemisphere, 
thus improving advance notice of extreme weather and increasing warning lead times. Key 
consumers of GOES products have said that they’d rather have the launch delayed than proceed 
without the GLM. 4 ' 

Delays Increase Risk of Satellite Data Gap 

NOAA’s policy is to always have two operational satellites and one back-up in orbit. 
However, in April 2015, NOAA expects to retire one of its operational satellites (GOES-13) and 
move the back-up (GOES- 14) into operation. 42 There will be no backup satellite until GOES-R 
is launched. According to a June 2012 GAO report, the likelihood of the first GOES-R satellite 
launching by October 2015 is less than 50 percent. 41 Once GOES-R is launched, it would first 
have to complete a post-launch test and calibration phase that lasts approximately six months 
before becoming operational. As previously mentioned, program officials acknowledged that the 
launch date will likely be delayed by six months. With a potential gap in the afternoon orbit of 
the polar-orbiting program and the possibility of gaps in all of the polar-orbits, a further gap in 
geostationary coverage exacerbates the hazardous risks to Americans from NOAA’s inability to 
monitor and forecast weather events. 


40 GAO-13-597, September 2013, p.24. 

41 GAO-13-597, September 2013, p.25. 

42 GAO-13-597, September 2013, p.30. 

43 GAO-12-576, June 2012, Pp.32-33. 


10 




13 


Figure 5: Potential GOES Coverage Gap 44 


Potential Gap in GOES Coverage 



j ” Projected gap in backup coverage" 


0 Launch date | | Poet launch test period { : 1 Available as backup Operational period 


Source: GAO anslysis of NOAA data. 


Incomplete Contingency Plans 

To prepare for a probable two-imager gap, NOAA has established contingency plans that 
are generally in line with government and industry best practices, but weaknesses remain. For 
instance, the satellite plan does not account for the impact on users due to the loss of capabilities 
under contingency operations. According to the GAO, NOAA has generally done a poor job of 
communicating with satellite data users regarding changes to GOES-R requirements and 
capabilities. 45 Also, NOAA’s contingency plans do not identify alternative solutions for 
preventing the launch delay of GOES-R on October 20 15. 46 A recent DOC Office of Inspector 
General (OIG) audit corroborates GAO’s findings and states, “NOAA needs to develop a 
comprehensive plan to mitigate the risk of potential launch delays and communicate to users and 
other stakeholders changes that may be necessary to maintain the first GOES-R satellite's launch 
readiness date.’" 47 


44 GAO-13-597, September 2013, p.31. 

45 GAO-13-597, September 2013, Pp.47-48. 

45 GAO-13-597, September 2013, Pp.45-46. 

47 Department of Commerce Office of Inspector General, “Audit of Geostationary Operational Environmental 
Satellite-R Series: Comprehensive Mitigation Approaches, Strong Systems Engineering, and Cost Controls Are 
Needed to Reduce Risks of Coverage Gaps,” OIG-13-024-A, April 25, 2013, p.4, available at: 
http://www.oig.doc.gov/OIGPublications/OIG-13-024-A.pdf. 
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Chairman Broun. This joint hearing of the Subcommittee on 
Oversight and the Subcommittee on Environment will come to 
order. 

Good morning and welcome to today’s joint hearing. In front of 
you are packets containing the written testimony, biographies, and 
truth-in-testimony disclosures for today’s witnesses. Before we get 
started, since this is a joint hearing involving two Subcommittees, 
I want to explain how we will operate procedurally so all Members 
understand how the question-and-answer period will be handled. 
We will recognize those Members present at the gavel in order of 
seniority on the full Committee and those coming in after the gavel 
will be recognized in their order of arrival. 

I now recognize myself for five minutes for an opening statement. 

Today’s hearing is titled “Dysfunction in Management of Weath- 
er and Climate Satellites. Let me begin by extending a warm wel- 
come to our witnesses and thank you all for appearing here today.” 

The Committee on Science, Space, and Technology has held 
about a dozen hearings on weather satellites, under both Repub- 
lican as well as Democratic leadership, all since 2003. Continued 
oversight is important because these programs are important. Data 
from these satellites not only help one decide whether or not to 
leave the house with an umbrella, they allow meteorologists to 
more accurately predict extreme weather, military planners to 
more intelligently deploy troops around the world, and emergency 
managers to better respond to wildfires and other natural disas- 
ters. 

Unfortunately, the programs have been plagued with problems. 
The Department of Commerce Office of Inspector General, the U.S. 
Government Accountability Office, and other independent review- 
ers have repeatedly assessed that the programs are at risk of ex- 
ceeding cost and missing deadlines due to a myriad of issues. Cit- 
ing ongoing concerns about potential data gaps for NOAA’s polar- 
orbiting and geostationary satellite programs, including a potential 
polar-orbiting gap of 17 to 53 months, GAO added NOAA’s satellite 
programs to its High Risk List in a report issued earlier this year. 

On that note, I want to take a moment to thank the GAO staff 
for their diligent work on this issue over the years. You have been 
a valuable resource to this Committee’s oversight efforts, and I 
want our witness Mr. Powner to know that I personally, and we 
as a Committee, appreciate your work and your presence here 
today. Thank you, sir. 

As I have said before, it is frustrating to watch these important 
programs struggle. But it is even more frustrating to be told by 
NOAA and NASA that “all is well” when we all know that that is 
not the case. An IG report, GAO reports, and a 2012 independent 
report sponsored by NOAA all say otherwise, with the independent 
report going so far as to use the word “dysfunctional” in its anal- 
ysis of the weather satellite programs. Another independent 
NOAA-commissioned report released this year described the possi- 
bility of the United States’ reliance on China for satellite data as 
a “silver bullet.” I have grave concerns about incorporating data 
into U.S. systems from a country well known for its persistent and 
malicious cyber attacks against our Nation. 
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The latest lifecycle cost estimate for JPSS is $11.3 billion, but it 
took some crafty accounting to arrive at that number. Along the 
way, the program went from six satellites operating in three sepa- 
rate orbits and carrying 11 unique sensors under NPOESS, the 
precursor to JPSS, to now two satellites, operating in one orbit, 
carrying only five sensors. Even with those downgrades, the first 
JPSS satellite isn’t scheduled to launch until March 2017. 

The GOES-R program is further along than JPSS, but it, too, is 
facing a potential data coverage gap. It is my understanding that 
NOAA expects to retire one of its operational satellites, GOES-13, 
and move the backup, GOES-14, into operation in April 2015. That 
means for at least six months, there will be no backup satellite, as- 
suming GOES-R is launched in October of 2015. Recently, however, 
program officials acknowledged that the launch date will likely slip 
by one quarter, which could result in a delay of as much as six 
months. And the cause for the delay? A $54 million sequester cut, 
according to NOAA staff. 

If money is so tight and our weather satellite programs are so 
vulnerable, then perhaps the Administration needs to evaluate its 
priorities and determine which is more important: near-term 
weather monitoring, which can save lives and property today, or 
beefing up NOAA’s climate portfolio in an effort to guess what the 
weather might be decades from now. 

I look forward to hearing our witnesses’ testimonies and receiv- 
ing some candid answers to our questions. Let me also make this 
general observation to you all: it is a lot easier for Congress to 
work collaboratively with the Administration on solving our sat- 
ellite problems if there is transparency about potential concerns. As 
such, I will ask you to please answer our questions later in a con- 
cise, straightforward, expeditious, and accurate manner. It will de- 
feat the purpose of this hearing if our questions are sidestepped 
through the use of bureaucratic doublespeak, as that will only try 
our patience and will waste our limited and valuable time. 

[The prepared statement of Mr. Broun follows:] 

Prepared Statement of Representative Paul C. Broun, Chairman, 
Subcommittee on Oversight 

I want to extend a warm welcome to our witnesses and thank them for appearing 
today. 

The Committee on Science, Space, and Technology has held about a dozen hear- 
ings on weather satellites, under both Republican and Democratic leadership, since 
2003. Continued oversight is important because these programs are important. Data 
from these satellites not only help one decide whether or not to leave the house with 
an umbrella, they allow meteorologists to more accurately predict extreme weather, 
military planners to more intelligently deploy troops around the world, and emer- 
gency managers to better respond to wildfires and other natural disasters. 

Unfortunately, the programs have been plagued with problems. The Department 
of Commerce Office of Inspector General, the U.S. Government Accountability Office 
and other independent reviewers have repeatedly assessed that the programs are 
at risk of exceeding cost and missing deadlines due to a myriad of issues. Citing 
ongoing concerns about potential data gaps for NOAA’s polar-orbiting and geo- 
stationary satellite programs, including a potential polar-orbiting gap of 17 to 53 
months, GAO added NOAA’s satellite programs to its High Risk List in a report 
issued earlier this year. 

On that note, I want to take a moment to thank the GAO staff for their diligent 
work on this issue over the years. You have been a valuable resource to this Com- 
mittee’s oversight efforts, and I want our witness Mr. Powner to know that we ap- 
preciate your work and your presence here today. 
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As I have said before, it is frustrating to watch these important programs strug- 
gle. But it is even more frustrating to be told by NOAA and NASA that “all is well” 
when we all know that is not the case. An IG report, GAO reports, and a 2012 inde- 
pendent report sponsored by NOAA all say otherwise, with the independent report 
going so far as to use the word “dysfunctional” in its analysis of the weather sat- 
ellite programs. Another independent NOAA-commissioned report released this year 
described the possibility of the United States’ reliance on China for satellite data 
as a “silver bullet.” I have grave concerns about incorporating data into U.S. sys- 
tems from a country well-known for its persistent and malicious cyber attacks 
against our nation. 

The latest lifecycle cost estimate for JPSS is $11.3 billion, but it took some crafty 
accounting to arrive at that number. Along the way, the program went from six sat- 
ellites, operating in three separate orbits and carrying 11 unique sensors under 
NPOESS, the precursor to JPSS, to now two satellites, operating in one orbit, car- 
rying only five sensors. Even with those downgrades, the first JPSS satellite isn’t 
scheduled to launch until March 2017. 

The GOES-R program is further along than JPSS, but it too is facing a potential 
data coverage gap. It is my understanding that NOAA expects to retire one of its 
operational satellites, GOES-13, and move the back-up, GOES-14, into operation in 
April 2015. That means for at least six months, there will be no backup satellite, 
assuming GOES-R is launched in October 2015. Recently, however, program officials 
acknowledged that the launch date will likely slip by one quarter, which could result 
in a delay of as much as six months. And the cause for the delay? A $54 million 
sequester cut, according to NOAA staff. 

If money is so tight and our weather satellite programs so vulnerable, then per- 
haps the Administration needs to evaluate its priorities and determine which is 
more important — near-term weather monitoring, which can save lives and property 
today, or beefing up NASA’s climate portfolio in an effort to guess what the weather 
might be decades from now. 

I look forward to hearing our witnesses’ testimonies and receiving some candid 
answers to our questions. Let me also make this general observation to you all: it 
is a lot easier for Congress to work collaboratively with the Administration on solv- 
ing our satellite problems if there is transparency about potential concerns. As such, 
I will ask you to please answer our questions later in a concise, straightforward, 
and accurate manner. It will defeat the purpose of this hearing if our questions are 
sidestepped through the use of bureaucratic doublespeak, as that will only try our 
patience and waste our limited time. 

Chairman Broun. I now recognize the Ranking Member, the 
gentleman from New York, my friend Mr. Maffei, for an opening 
statement. 

Mr. Maffei. I want to thank my friend, the Chairman, and I 
want to apologize for being just a couple minutes late today. We 
are going to be talking about how it is difficult to protect the 
weather. Apparently, it is difficult to predict the traffic in Wash- 
ington as well. 

But, Mr. Chairman, the weather satellites we have flying over 
the poles and in geostationary orbits over the East and West Coast 
provide essential data for weather forecasting. And both the Joint 
Polar Satellite System and the Geostationary Operational Environ- 
mental Satellite are essential acquisition programs intended to put 
replacements on orbit for the current generation of operating sat- 
ellites. Unfortunately, both of these acquisitions have been trou- 
bled, and that is why I am grateful to you for holding this hearing 
today, as well as Chairman Stewart. 

Of the two, JPSS is far and away in the most trouble. It will 
produce a definite gap in coverage due to the technical and cost 
challenges which have plagued the program. The Geostationary 
program is also worrisome with an ongoing possibility of a data gap 
emerging due to schedule slips. Obviously, none of us are happy 
about this. However, it has been suggested in some locations that 
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this might be something tied to the cost of doing climate science, 
and I don’t believe this is the case. 

When the Obama Administration took office, they inherited a 
crippled program already. It lacked planning and management 
guidance to move forward. It had experienced cost growth from 6.5 
billion to at least 12.5 billion. For almost 100 percent of the 
growth, we were getting two satellites instead of six, and we had 
jettisoned many sensors. This is what the Administration inherited 
and they had to make hard decisions about how to move the pro- 
gram forward, and that took almost two years to get the Defense 
Department out of the program and NOAA and NASA on a fresh 
path. 

Any observer, I think, would have to conclude that the restruc- 
tured JPSS program is better managed and better structured now 
than it was in 2008, and that we should be proud of, but there are 
still gaps in the management tools needed in JPSS. Again, com- 
pared to where we were between 2005 and 2008, the bleeding has 
stopped and the slips seem relatively small. With that said, we are 
still facing an inevitable gap in coverage and what to do about that 
gap is going to be and should be explored today. 

The Geostationary Satellite program has always been a little 
healthier than JPSS. It has suffered from more technical issues 
and less relative cost growth and enjoyed more stable management 
than the polar program. That said, there is still a chance of a gap 
in coverage that would be tragic. NOAA has to keep the track — 
keep on track to get our satellites in orbit and working before the 
current geostationary satellites go dark. We need satellites ready 
for launch to avoid limit or gap in coverage. We need clear plans 
for alternative sources of data to protect accurate forecasting. And 
we need to make sure that we are not forced to depend on other 
countries such as the People’s Republic of China that the Chairman 
rightfully pointed out would have unacceptable downsides to that 
kind of relationship. We need to be confident that both of these pro- 
grams are going to succeed even by the diminished expectations we 
now hold for them. 

And with that, I yield back to you, Mr. Chairman, and I thank 
you again for holding the hearing. 

[The prepared statement of Mr. Maffei follows:] 

Prepared Statement of Representative Dan Maffei, Ranking Minority 
Member, Subcommittee on Oversight 

Mr. Chairman, the weather satellites we fly over the poles and in geostationary 
orbits over the East and West coasts provide essential data for weather forecasting. 

Both the Joint Polar Satellite System (JPSS) and the Geostationary Operational 
Environmental Satellite (GOES-R) are essential acquisition programs intended to 
put replacements on-orbit for the current generation of operating satellites. Unfortu- 
nately, both these acquisitions have been troubled. 

Of the two, JPSS is far and away in the most trouble, and will produce a definite 
gap in coverage due to the technical and cost challenges which have plagued the 
program. GOES-R is also worrisome, with an ongoing possibility of a data gap 
emerging due to schedule slips. 

None of us are happy about this. However, it has been suggested that somehow 
the problems in these programs are tied to the costs of climate science. This is just 
not the case. 

When the Obama Administration took office, they inherited a crippled program 
that lacked all the planning and management guidance necessary to move forward. 
It had experienced cost growth from $6.5 billion to at least $12.5 billion. For almost 
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100 percent cost growth we were getting two satellites instead of six and we had 
jettisoned many sensors. The Administration inherited hard decisions about how to 
move the program forward and it took almost two years to get DOD out of the pro- 
gram and NOAA and NASA on a fresh path. 

Any objective observer would have to conclude that the restructured JPSS pro- 
gram is better managed and better structured now than it was in 2008. There are 
still gaps in the management tools need in JPSS, but compared to where we were 
in 2005 through 2008, the bleeding has stopped and the slips seem relatively small. 

That said, we are facing an inevitable gap in coverage. While that cannot be laid 
at the feet of this Administration, we can ask of the Administration whether they 
have put necessary resources into settling on a valid gap-filler strategy. Have they 
identified other sources of data? Do they have all agreements in place to insure they 
have unbroken access to that data? What steps have been taken to validate the ef- 
fects of that data on our modeling to insure that we minimize impacts on forecast 
accuracy? These are crucial questions that I would like to see answered today. 

As to GOES-R, that program has always been a little healthier than JPSS. It has 
suffered from fewer technical issues and less relative cost growth, and enjoyed more 
stable management than the polar program. That said, there is still a chance that 
a gap in coverage could emerge and that would be tragic. NOAA has to keep on 
track to get us satellites on orbit and working before the current GOES satellites 
go dark. The recent slip narrows the margin for error and is a cause for concern 
among all of us. 

We need satellites ready for launch to avoid or limit coverage gaps. We need clear 
plans for alternative sources of data to protect forecasting accuracy. We need con- 
fidence that both these programs are going to succeed, even by the diminished ex- 
pectations we now hold for them. 

Chairman Broun. Thank you, Mr. Maffei. 

I now recognize the Chairman of the Subcommittee on Environ- 
ment, the gentleman from Utah, Mr. Stewart, for his opening state- 
ment. 

Mr. Stewart. Thank you, Dr. Broun, for holding this important 
hearing. I would like to thank the witnesses for being with us 
today. We look forward to hearing from you and for your expertise 
and for your service to our country. 

I think all of us agree this is an important issue. I think we all 
sense the clock is ticking and there is a sense of urgency of trying 
to move forward in a way that is, I think, beneficial. 

The Science Committee has a long history of overseeing the man- 
agement of NOAA and NASA weather and climate satellite sys- 
tems. Unfortunately, these programs have been rife with delays 
and other issues for more than a decade now, as has already been 
expressed by the two previous opening statements. Topics at issue 
today are also very timely in that they relate to legislation being 
considered by this Committee, the Weather Forecasting Improve- 
ment Act of 2013, which attempts to focus critical resources on de- 
veloping a top-notch weather forecasting system based on stream- 
lined research-to-operations and a more reasonable balance of re- 
sources toward weather research. 

All of our witnesses acknowledge the strong possibility of a data 
gap for one or both of our major weather satellite systems in a few 
short years. These satellites provide the majority of data for nu- 
merical weather predictions in this country, and a gap could be cat- 
astrophic for forecasting by the National Weather Service and our 
innovative weather enterprise. A potential gap in the polar-orbiting 
or geostationary satellite data, combined with continuing issues 
with how NOAA develops, analyzes, procures and integrates other 
satellite information, risks the permanent loss of U.S. leadership in 
weather forecasting. I believe the writing is on the wall, and our 
current trajectory is simply unacceptable. 
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As the Government Accountability Office will testify, our geo- 
stationary and polar-orbiting programs, known as GOES and JPSS, 
have been — again, indicated in previous testimony or opening 
statements, they have been plagued with cost overruns, with tech- 
nical issues, and other delays. And we need to consider the right 
mix of satellite technology to make timely, accurate, and effective 
forecasts to protect American lives and property. 

For our polar-orbiting satellites, not only is there a potential gap 
in the 2016 to 2018 time frame, but there may also be issues be- 
tween the first and second JPSS satellites in the early 2020s. 

While the GOES-R program has made progress in completing 
testing for several components, the program has still missed sev- 
eral key milestones for both flight and ground segments. This has 
caused the launch date for the GOES-R to slip from October 2015 
to perhaps March of 2016. There are also other technical problems 
on the horizon, including the Geostationary Lightning Mapper, an 
instrument that appears to duplicate some already-existing com- 
mercial capabilities. 

Robust contingency planning and implementation of these plans, 
as suggested by GAO, is essential. We have seen that it has taken 
several years for NOAA to validate key products on the SUOMI- 
NPP satellite. Just after the Oklahoma tornadoes this year, a 
micrometeoroid appears to have hit an existing GOES satellite, 
turning off all of its instruments. Murphy’s Law seems to be on full 
display when it comes to our weather satellites, and continued blue 
sky evaluations by NOAA could prevent us from dealing with these 
problems before they arise. 

It has taken the Administration several years and the prodding 
of this Committee as well as GAO to fully acknowledge the very 
real risk of a data gap, and we need to look at all options to miti- 
gate potential breakdowns in our forecasting ability. While NOAA 
has paid for reports to examine gap mitigation options, I have fear 
that not enough has been done to pursue implementation of these 
backup plans. 

We need to look at American, as well as potentially commercial, 
sources for these critical data. It should be alarming that we may 
be in a position to have to rely on international partners for weath- 
er data and to protect lives and property, an outcome that could 
raise much greater quality and access concerns than some of our 
other potential commercial partners that have so far been rebuffed 
by NOAA. 

And with that, Mr. Chairman, I now yield back. 

[The prepared statement of Mr. Stewart follows:] 

Prepared Statement of Subcommittee on Environment Chairman Chris 

Stewart 

Thank you, Dr. Broun, for holding this important hearing. The Science Committee 
has a long history overseeing the management of NOAA and NASA weather and 
climate satellite systems. Unfortunately, these programs have been rife with issues 
for more than a decade. Topics at issue today are also very timely as they relate 
to legislation being considered by this Committee, “The Weather Forecasting Im- 
provement Act of 2013,” which attempts to focus critical resources on developing a 
top notch weather forecasting system based on streamlined research-to-operations 
and a more reasonable balance of resources toward weather research. 
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All of our witnesses acknowledge the strong possibility of a data gap for one or 
both of our major weather satellite systems in a few short years. These satellites 
provide the majority of data for numerical weather prediction in this country, and 
a gap could be catastrophic for forecasting by the National Weather Service and our 
innovative weather enterprise. A potential gap in polar-orbiting or geostationary 
satellite data, combined with continuing issues with how NOAA develops, analyzes, 
procures and integrates other satellite and observational information, risks the per- 
manent loss of U.S. leadership in weather forecasting. The writing is on the wall, 
and our current trajectory is unacceptable. 

As the Government Accountability Office will testify, our geostationary and polar- 
orbiting programs, known as GOES and JPSS, have been plagued with cost over- 
runs, technical issues, and delays. We need to consider the right mix of satellite 
technology to make timely, accurate, and effective forecasts to protect American 
lives and property. 

For our polar orbiting satellites, not only is there a potential gap in the 2016 to 
2018 timeframe, but there may also be issues between the first and second JPSS 
satellites in the early 2020s. 

While the GOES-R program has made progress in completing testing for several 
components, the program has still missed several key milestones for both flight and 
ground segments. This has caused the launch date for GOES-R to slip from October 
2015 to March 2016. There are also other technical problems on the horizon, includ- 
ing with the Geostationary Lightning Mapper, an instrument that also appears to 
duplicate some already-existing commercial capabilities. 

Robust contingency planning and implementation of those plans as suggested by 
GAO is essential. We have seen that it has taken several years for NOAA to vali- 
date key products on the SUOMI-NPP satellite. Just after the Oklahoma tornadoes 
this year, a micrometeoroid appears to have hit an existing GOES satellite, turning 
all of its instruments off. Murphy’s Law seems to be on full display when it comes 
to our weather satellites, and continued blue sky self-evaluations by NOAA could 
prevent us from dealing with these problems before they arise. 

It has taken the Administration several years and the prodding of this Committee 
and GAO to fully acknowledge the very real risk of a data gap, and we need to look 
at all options to mitigate potential breakdowns in our forecasting ability. While 
NOAA has paid for reports to examine gap mitigation options I have fear that not 
enough has been done to pursue implementation of these backup plans. We need 
to look at American, and potentially commercial, sources for these critical data. It 
should be alarming that we may be in a position of having to rely on international 
partners for weather data to protect lives and property, an outcome that could raise 
much greater quality and access concerns than some of the potential commercial 
partners that have so far been rebuffed by NOAA. 

Chairman Broun. Thank you, Mr. Stewart. 

The Chairman now recognizes Ms. Bonamici, the Ranking Mem- 
ber of the Environment Subcommittee, for her statement. 

Ms. Bonamici. Thank you very much, Chairman Broun and 
Chairman Stewart, for holding this hearing today and thank you 
to all of our witnesses who are here today. We look forward to your 
testimony and answers. 

Our constituents may spend little time thinking about weather 
satellites managed by NOAA, but we have all at some point been 
transfixed by the images of hurricanes captured by NOAA’s Geo- 
stationary Operational Environmental Satellites, and we all benefit 
from the forecasts, especially of severe storms that result from data 
collected in polar and geostationary satellite systems. 

As Mr. Stewart mentioned on the Environment Subcommittee, 
we have been working on how to improve weather forecasting and 
protect the American public and economy from severe weather. 
Losing coverage from either of the polar satellite or the geo- 
stationary satellites would seriously affect accurate weather fore- 
casting. Because of a litany of troubles in the polar program, it now 
appears virtually certain that we will have a gap in satellite cov- 
erage perhaps for as long as three years, and there remains a 
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chance, not a probability but a possibility, that we may face a gap 
in the geostationary satellites as well. There was a time when we 
would all say that a gap in coverage is unacceptable, and now what 
would be unacceptable would be not having a viable plan to ad- 
dress such a gap. 

And with that in mind, the questions for our witnesses today 
have to be how do we minimize the scope and length of the ex- 
pected gap in the polar program? How can we avoid a gap in the 
geostationary program? And are the plans to fill the gaps in cov- 
erage appropriately developed? 

On the Joint Polar Satellite System program, we have had eight 
years to determine how to handle a gap, and as early as 2005, we 
were getting warnings of slips in schedule and instrument issues 
and cost growth. Today, I am interested in hearing about NOAA’s 
definitive plan for how to deal with the gap they know they will 
face for polar satellite data. 

And on the GOES satellites, a potential for a gap has been slow- 
er in developing and still appears to be avoidable. However, even 
here I would expect and hope that NOAA has started to think 
about a contingency plan should the satellites suffer early failure 
and the replacement satellite suffer further delay. Of course we all 
hope everything performs optimally, but I would also hope that 
prudent managers would develop a plan for failure. 

I want to join Mr. Maffei in expressing my regret and frankly 
surprised that the majority charter for the hearing suggests that 
the problems in NOAA’s satellite program are somehow tied to cli- 
mate science research. That simply is not accurate, and anyone 
who spends time looking at the history of these programs would be 
hard-pressed to identify climate research as even a factor in the 
technical problems, the schedule slips, or cost growth in the last 
eight years. Further, the majority charter seems to perpetuate 
what has become a common misconception in this Committee, that 
climate research is the same thing as climate change research. 

Colleagues, the issue before us today has been ongoing for years. 
My hope is that we can set aside partisanship and find solutions 
to what really is a slow-moving national tragedy. We should 
emerge from this hearing with a bipartisan commitment to work 
together and to help ensure that NOAA is doing all it can and 
should to manage these programs and plan for and cover any gaps. 
I also hope we can work together to support NOAA in getting any 
resources it needs to continue to protect the American public. I look 
forward to hearing from the witnesses from GAO, NOAA, and 
NASA, and to discuss the relevant agencies’ plan of action to ad- 
dress the looming satellite coverage gaps and to keep these pro- 
grams on track. 

Thank you very much, Mr. Chairman, and with that, I yield 
back. 

[The prepared statement of Ms. Bonamici follows:] 

Prepared Statement of Subcommittee on Environment Ranking Member 

Suzanne Bonamici 

Thank you, Chairman Stewart and Chairman Broun, for holding the hearing 
today. Our constituents may spend little time thinking about weather satellites 
managed by the National Oceanic and Atmospheric Administration, but we have all 
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at some point been transfixed by the images of hurricanes captured by NOAA’s Geo- 
stationary Operational Environmental Satellites. And we all benefit from the fore- 
casts-especially of severe storms — that result from data collected in the polar and 
geostationary satellite systems. 

On this Committee, we have been working on how to improve forecasting and pro- 
tect the American public and economy from severe weather. Losing coverage from 
either the polar satellites or the geostationary satellites would seriously affect accu- 
rate weather forecasting. 

Because of trouble and mismanagement in the polar program, it now appears vir- 
tually certain that we will have a gap in satellite coverage, perhaps for as long as 
three years. And there remains a chance, not a probability but a possibility, that 
we may face a gap in the geostationary satellites as well. 

There was a time when we would all say that a gap in coverage was unacceptable. 
Now what is unacceptable is not having a viable plan to address such a gap. 

With that in mind, the questions for our witnesses have to be: 

• How can we minimize the scope and length of the expected gap in the polar 
program, 

• How can we avoid a gap in the geostationary program, and 

• Are plans to fill gaps in coverage appropriately mature? 

On the Joint Polar Satellite System program we have had eight years to deter- 
mine how to handle a gap. As early as 2005, we were getting warnings of slips in 
schedule and instrument issues and cost growth. 

Today I am interested in hearing about NOAA’s definitive plan for how to deal 
with a gap they know they will face for polar satellite data. On the GOES satellites, 
the potential for a gap has been slower in developing and still appears to be avoid- 
able. However, even here, I would expect that NOAA has started to think about a 
contingency plan should the current satellites suffer early failure and the replace- 
ment satellite suffer further delay. Of course we all hope everything performs opti- 
mally, but also I would hope that prudent managers will develop a plan for failure. 

I want to join Mr. Maffei in expressing my regret, and frankly surprise, that the 
Majority charter for this hearing suggests the problems in NOAA’s satellite program 
are somehow tied to climate science. That simply is not true and anyone who wants 
to spend some time looking at the history of these programs would be hard pressed 
to identify climate as even a factor in the technical problems, schedule slips, or cost 
growth of the last eight years. Further, the majority charter seems to perpetuate 
what has become a common misconception on this committee: that climate research 
is the same thing as climate change research. 

Colleagues, this is an issue that has been ongoing for years. My hope today is that 
we can set aside partisanship and find solutions to what really is a slow-moving, 
national tragedy. We should emerge from this hearing with a bipartisan commit- 
ment to work together and help ensure that NOAA is doing all that it can and 
should to manage these programs and plan for gaps. I also hope we can work to- 
gether to support NOAA in getting the resources they need to continue to protect 
the American public I look forward to hearing the witnesses from GAO, NOAA, and 
NASA discuss how the relevant agencies plan of action to address the looming sat- 
ellite coverage gap and to keep these programs on track. 

Chairman Broun. Thank you, Ms. Bonamici. 

If there are Members who wish to submit additional opening 
statements, your statements will be added to the record at this 
point. 

At this time, I would like to introduce our panel of witnesses. 
Our first witness is Mr. David Powner, Director of Information 
Technology Management Issues at the U.S. Government Account- 
ability Office. Mr. Powner, welcome. 

Our second witness is Ms. Mary Kicza, Assistant Administrator 
for Satellite and Information Services at the National Oceanic and 
Atmospheric Administration. Welcome. 

And our third witness is Mr. Marcus Watkins, Director of the 
Joint Agency Satellite Division at the National Aeronautics and 
Space Administration. Welcome, sir. 
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As our witnesses should know, spoken testimony is limited to 
five minutes each, after which the Members of the Committee will 
have five minutes each to ask you all questions. 

It is the practice of this Subcommittee to receive testimony under 
oath. Now, if you would please stand and raise your right hand. 

Do you solemnly swear or affirm to tell the whole truth and 
nothing but the truth, so help you God? 

Thank you. You may be seated. 

Let the record reflect that all the witnesses participating have 
taken the oath. 

Now, before I recognize the first witness, let me just make a cou- 
ple of points. I am very eager to hear your testimonies, but I would 
have appreciated the opportunity to read the NOAA and NASA tes- 
timonies 48 hours ago when they were due. I understand and I 
hope neither of you are directly responsible for the tardiness of 
submitting your testimony to this Committee, but I would like for 
you to pass the message along to the appropriate person or individ- 
uals that it is inconsiderate to provide testimony less than 48 hours 
before a hearing less than 24 hours before a hearing when the 
deadline is 48 hours. You were both given ample notice about this 
hearing, in fact, on August 14th, which was over a month ago, and 
yet you were unable to provide the testimonies as requested. 

I am further frustrated by NASA when I consider that the agen- 
cy declined to send another witness requested by the Committee 
and it still submitted testimony late. 

When testimony is delivered this late, it does not provide Mem- 
bers of the Committee sufficient time to review and prepare to en- 
gage in an informative discussion with you about these programs. 
Your tardiness is intolerable and it reflects poorly on your respec- 
tive agencies and the Administration by default as well. 

Further, will you please confirm that you will personally ensure 
that the Committee receives responses to our questions for the 
record following the hearing in a timely manner that is closer to 
two weeks than two months? 

Ms. Kicza nodded her head and you assure us that, Mr. Watkins? 

He nodded his head yes, too, so I am counting that as a commit- 
ment on both of your part. 

And I am looking specifically at you, Ms. Kicza, because as you 
well know, NOAA has yet to reply to questions from the Committee 
relative to a hearing on the National Weather Service held over a 
year ago. You are aware. That hearing in which your colleague, Dr. 
Sullivan, testified before us here, do you have an update on the sta- 
tus of those responses? Could you please give us an update from 
the agency as soon as possible? We are eagerly awaiting those re- 
sponses and I think it is inappropriate and inconsiderate. Thank 
you. 

I thank you and I appreciate everyone’s indulgence. 

Now, I recognize Mr. Powner for five minutes. 

TESTIMONY OF MR. DAVID POWNER, DIRECTOR, 
INFORMATION TECHNOLOGY MANAGEMENT ISSUES, 

U.S. GOVERNMENT ACCOUNTABILITY OFFICE 

Mr. Powner. Mr. Chairman, Ranking Members, and Members of 
the Subcommittee, earlier this year GAO added the potential gaps 
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in weather satellite coverage in consultation with this Committee 
as a high-risk area demanding immediate attention from NOAA 
management. Gaps in weather satellite coverage are likely and 
could have severe effects on lives and our economy. Therefore, our 
country needs the very best backup plans that budgets can afford. 

This morning, we are releasing two reports completed at your re- 
quest, one on the GOES-R acquisition and the other on JPSS, 
which address the gap situation and contingency efforts. I would 
like to highlight our recommendations and findings on each, start- 
ing with GOES. 

There has been significant progress on the flight and ground 
components. The flight components are at various stages leading 
up to key systems integration and the spacecraft construction start- 
ed earlier this year. Integration of ground components is slated to 
occur in early 2014, and the program is currently operating within 
its $10.5 billion lifecycle cost estimate. 

Turning to the launch date of October 2015, last year, we re- 
ported to this Committee that there was a 40 percent chance the 
GOES-R would meet its October launch date, and our report today 
highlights technical issues, delayed interim milestones, and sched- 
uling weaknesses that call into question that launch date. 

Right after we received NOAA’s comments on our report, they 
did in fact slip the launch date to early 2016. Although this slip 
might not appear significant, it is since it extends the period of 
time where there will be no operational backup satellite for about 
a year-and-a-half from April 2015 until GOES-R launches and com- 
pletes the 6-month check-out. Having this backup satellite in orbit 
at all times is an essential NOAA policy, as it has proved useful 
on multiple occasions over the past several years when one of the 
two operational GOES satellites has experienced issues and the 
backup had to be moved into position to provide weather observa- 
tions. 

NOAA has fairly solid contingency plans to address the scenario, 
many consistent with best practices, but our report points out some 
areas where improvements are needed, primarily in areas focusing 
on preventing launch delays. We are also making recommendations 
on improving the spacecraft and ground schedules so that addi- 
tional delays do not occur. 

Moving to JPSS, again, there is very solid progress to report. 
NPP transitioned from interim to routine operations in February of 
this year and key upgrades to the ground system have been made. 

Regarding JPSS-1, flight project is on track and instruments are 
between and 80 and 100 percent complete and the critical design 
review has been completed on the spacecraft. However, although 
the JPSS ground project has made progress, a major software re- 
lease has been delayed. 

Also, major revisions to the programs scope are occurring to keep 
it within the $11.3 billion lifecycle cost estimate. Last year, when 
we testified, the program was going from $14.6 billion to $12.9 bil- 
lion; now, it is at $11.3 billion. That is a $3.3 billion reduction in 
not a very long time. NOAA is reporting the bulk of the savings 
as coming from moving certain climate sensors outside of the JPSS 
program and also moving other sensors to NASA. There are many 
uncertainties associated with these moves, namely, what satellites 
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these sensors will fly on and whether these savings will truly allow 
the program to operate within the $11.3 billion cost estimate. 

We looked in depth at the schedules of VIIRS, the ground compo- 
nent in the spacecraft. We found issues with certain components’ 
schedules and the program overall did not have an integrated mas- 
ter schedule. All this is necessary to stay on track for the March 
2017 launch date. 

In addition, NOAA and NASA are reporting they have a 70 per- 
cent confidence in the JPSS-1 March 2017 launch date. Our con- 
fidence is much lower because the 70 percent assessment did not 
factor in the scheduling weaknesses we raised in our report. Hit- 
ting this March 2017 launch date is extremely important because 
any delays will extend the likely 17-month gap in the afternoon 
orbit. The gap will likely occur from late 2016 to early 2018. 

NOAA had an initial contingency plan to address the gap and re- 
cently contracted for technical assessment that identified additional 
alternatives. Options included using other government foreign and 
commercial satellite, using non-satellite sources such as aircraft ob- 
servations and improving weather models. This list is quite exten- 
sive, but let’s be clear. None of the options can replace JPSS polar 
satellite observations. These options can minimize the gaps but do 
not eliminate the damage to forecasts from the gap. Because of 
this, the very best contingency options need to be selected. 

Therefore, we recommended that decisions need to be made on 
exactly what strategies to be pursued and the procedures need to 
be established to implement and adequately test them. We are also 
making recommendations on improving the spacecraft and ground 
schedules so that the March 2017 launch date does not slip. 

Mr. Chairman, this concludes my statement. Thank you for your 
leadership and oversight of these critical acquisitions. 

[The prepared statement of Mr. Powner follows:] 
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Chairman Broun, Chairman Stewart, Ranking Member Maffei, Ranking 
Member Bonamici, and Members of the Subcommittees: 

Thank you for the opportunity to participate in today’s hearing on two 
satellite program acquisitions within the Department of Commerce's 
National Oceanic and Atmospheric Administration (NOAA). Both the Joint 
Polar Satellite System (JPSS) and the Geostationary Operational 
Environment Satellite-R series (GOES-R) programs are meant to replace 
current operational satellite programs, and both are considered critical to 
the United States’ ability to maintain the continuity of data required for 
weather forecasting. 

As requested, this statement summarizes our two reports being released 
today on (1) the JPSS program’s status and plans, schedule quality, and 
gap mitigation strategies, and (2) the GOES-R program's status, 
requirements management, and contingency planning. 1 (n preparing this 
testimony, we relied on the work supporting those reports. They each 
contain a detailed overview of our objectives, scope, and methodology, 
including the steps we took to assess the reliability of cost and schedule 
data. As noted in those reports, we found that the JPSS data on schedule 
milestones and estimated savings, and GOES-R data on schedules and 
cost reserves were sufficiently reliable for our purposes. All of our work 
for the reports was performed in accordance with generally accepted 
government auditing standards. Those standards require that we plan 
and perform the audit to obtain sufficient, appropriate evidence to provide 
a reasonable basis for our findings and conclusions based on our audit 
objectives. We believe that the evidence obtained provides a reasonable 
basis for our findings and conclusions based on our audit objectives. 


Background 

Since the 1960s, the United States has used polar-orbiting and 
geostationary satellites to observe the earth and its land, ocean, 
atmosphere, and space environments. Polar-orbiting satellites constantly 
circle the earth in a nearly north-south orbit, providing global coverage of 
conditions that affect the weather and climate. As the earth rotates 


1 GAO, Polar Weather Satellites: NOAA Identified Ways to Mitigate Data Gaps, but 
Contingency Plans and Schedules Require Further Attention, GAO-13-676 (Washington, 
D.C.: Sept. 11, 2013) and GAO, Geostationary Weather Satellites: Progress Made, but 
Weaknesses in Scheduling, Contingency Planning, and Communicating with Users Needs 
to be Addressed, GAO-13-597 (Washington, D.C.: Sept. 9, 2013). 
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beneath it, each polar-orbiting satellite views the entire earth's surface 
twice a day. In contrast, geostationary satellites maintain a fixed position 
relative to the earth from a high orbit of about 22,300 miles in space. 

Both types of satellites provide a valuable perspective of the environment 
and allow observations in areas that may be otherwise unreachable. 

Used in combination with ground, sea, and airborne observing systems, 
satellites have become an indispensable part of monitoring and 
forecasting weather and climate. For example, polar-orbiting satellites 
provide the data that go into numerical weather prediction models, which 
are a primary tool for forecasting weather days in advance — including 
forecasting the path and intensity of hurricanes. Geostationary satellites 
provide the graphical images used to identify current weather patterns 
and provide short-term warning. These weather products and models are 
used to predict the potential impact of severe weather so that 
communities and emergency managers can help prevent and mitigate its 
effects. 

Federal agencies are currently planning and executing major satellite 
acquisition programs to replace existing polar and geostationary satellite 
systems that are nearing the end of their expected life spans. However, 
these programs have troubled legacies of cost increases, missed 
milestones, technical problems, and management challenges that have 
resulted in reduced functionality and major delays to planned launch 
dates over time. We and others — including an independent review team 
reporting to the Department of Commerce and its Inspector General- 
have raised concerns that problems and delays on environmental satellite 
acquisition programs will result in gaps in the continuity of critical satellite 
data used in weather forecasts and warnings. According to officials at 
NQAA, a polar satellite data gap would result in less accurate and timely 
weather forecasts and warnings of extreme events, such as hurricanes, 
storm surge and floods. Such degradation in forecasts and warnings 
would place lives, property, and our nation’s critical infrastructures in 
danger. The importance of having such data available was highlighted in 
2012 by the advance warnings of the path, timing, and intensity of 
Superstorm Sandy. Given the criticality of satellite data to weather 
forecasts, concerns that problems and delays on the new satellite 
acquisition programs will result in gaps in the continuity of critical satellite 
data, and the impact of such gaps on the health and safety of the U.S. 
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population, we concluded that the potential gap in weather satellite data is 

a high-risk area and we added it to our High-Risk List in February 201 3. 2 

Events Leading to the JPSS Program 

For over forty years, the United States has operated two separate 
operational polar-orbiting meteorological satellite systems: the Polar- 
orbiting Operational Environmental Satellite series, which is managed by 
NOAA, and the Defense Meteorological Satellite Program, which is 
managed by the Air Force. 3 Currently, there is one operational Polar- 
orbiting Operational Environmental Satellite and two operational Defense 
Meteorological Satellite Program satellites that are positioned so that they 
cross the equator in the early morning, midmorning, and early afternoon. 
In addition, the government relies on data from a European satellite, 
called the Meteorological Operational satellite. 4 

With the expectation that combining the Polar-orbiting Operational 
Environmental Satellite program and the Defense Meteorological Satellite 
Program would reduce duplication and result in sizable cost savings, a 
May 1994 Presidential Decision Directive 5 required NOAA and the 
Department of Defense (DOD) to converge the two satellite programs into 
a single satellite program — the National Polar-orbiting Operational 
Environment Satellite System (NPOESS)-— capable of satisfying both 
civilian and military requirements. To manage this program, DOD, NOAA, 
and the National Aeronautics and Space Administration (NASA) formed a 
tri-agency integrated program office. However, in the years after the 
program was initiated, NPOESS encountered significant technical 
challenges in sensor development, program cost growth, and schedule 
delays. Specifically, within 8 years of the contract’s award, program costs 
grew by over $8 billion, and launch schedules were delayed by over 5 


2 Every two years at the start of a new Congress, GAO calls attention to agencies and 
program areas that are high risk due to their vulnerabilities to fraud, waste, abuse, an d 
mismanagement, or are most in need of transformation. See GAO, High Risk Series: An 
Update, GAO-13-283 (Washington, D.C.: Feb. 2013). 

3 NOAA provides command and control for both the Polar-orbiting Operational 
Environmental Satellite and Defense Meteorological Satellite Program satellites after they 
are in orbit. 

4 The European Organisation for the Exploitation of Meteorological Satellites' MetOp 
program is a series of three polar-orbiting satellites dedicated to operational meteorology. 
MetOp satellites are planned to be flown sequentially over 14 years. The first of these 
satellites was launched in 2006, the second was launched in 2012, and the final satellite in 
the series is expected to launch in 2017. 

Presidential Decision Directive NSTC-2, May 5, 1994. 
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years. In addition, as a result of a 2006 restructuring of the program, the 
agencies reduced the program’s functionality by decreasing the number 
of originally planned satellites, orbits, and instruments. 

Even after this restructuring, however, the program continued to 
encounter technical issues, management challenges, schedule delays, 
and further cost increases. Therefore, in August 2009, the Executive 
Office of the President formed a task force, led by the Office of Science 
and Technology Policy, to investigate the management and acquisition 
options that would improve the program. As a result of this review, the 
Director of Office of Science and Technology Policy announced in 
February 2010 that NOAA and DOD would no longer jointly procure 
NPOESS; 6 instead, each agency would plan and acquire its own satellite 
system. Specifically, NOAA would be responsible for the afternoon orbit, 
and DOD would be responsible for the early morning orbit. The 
partnership with the European satellite agencies for the midmorning orbit 
would continue as planned. 

When this decision was announced, NOAA and NASA immediately began 
planning for a new satellite program in the afternoon orbit — called JPSS — 
and DOD began planning for a new satellite program in the morning 
orbit — called the Defense Weather Satellite System, which has since 
been canceled. 7 After the February 2010 decision to disband NPOESS, 
NOAA established a program office to guide the development and launch 
of the Suomi National Polar-orbiting Partnership (S-NPP) satellite 8 — a 
demonstration satellite that was developed under NPOESS and managed 
by NASA— as well as the two planned JPSS satellites, known as JPSS-1 
and JPSS-2. NOAA also worked with NASA to establish its program office 
to oversee the acquisition, system engineering, and integration of the 
satellite program. NOAA estimates that the life cycle costs for the JPSS 
program will be $11.3 billion through fiscal year 2025. The current 
anticipated launch date for the first JPSS satellite is March 2017, with a 
second satellite to be launched in December 2022. 


6 The announcement accompanied the release of the President’s fiscal year 2011 budget 
request. 

7 After the decision to disband NPOESS, DOD established its Defense Weather Satellite 
System program office and modified its contracts accordingly before deciding in early 
2012 to terminate the program and reassess its requirements {as directed by Congress). 

fl 0rig'mally called the NPOESS Preparatory Project, in January 2012 the name of the 
satellite was changed to the Suomi National Polar-orbiting Partnership satellite. 
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Over the last several years, we have issued a series of reports on the 
NPOESS program — and the transition to JPSS — that highlight the 
technical issues, cost growth, key management challenges, and key risks 
of transitioning from NPOESS to JPSS. 9 In these reports, we made 
multiple recommendations to, among other things, improve executive- 
level oversight and establish mitigation plans for risks associated with 
pending polar satellite data gaps. NOAA has taken steps to address our 
recommendations, including taking action to improve executive-level 
oversight and in working to establish a contingency plan to mitigate 
potential gaps in polar satellite data. We subsequently assessed NOAA’s 
progress in implementing both of these recommendations in our reports 
being issued today. 

Overview of the GOES-R Program 

In addition to the polar-orbiting satellites, NOAA operates GOES as a 
two-satellite geostationary satellite system that is primarily focused on the 
United States. The GOES-R series is the next generation of satellites that 
NOAA is planning; the satellites are planned to replace existing weather 
satellites that will likely reach the end of their useful lives in about 2015. 

NOAA is responsible for GOES-R program funding and overall mission 
success. The NOAA Program Management Council, which is chaired by 
NOAA’s Deputy Undersecretary, is the program oversight body for the 
GOES-R program. However, since it relies on NASA’s acquisition 
experience and technical expertise to help ensure the success of its 
programs, NOAA implemented an integrated program management 
structure with NASA for the GOES-R program. Within the program office, 
there are two project offices that manage key components of the GOES-R 
system. NOAA has delegated responsibility to NASA to manage the Flight 
Project Office, including awarding and managing the spacecraft contract 


9 See, for example, GAO, Environmental Satellites: Focused Attention Needed to Mitigate 
Program Risks, GAO-12-841T (Washington, D C.: June 27, 2012); Polarorbiting 
Environmental Satellites: Changing Requirements, Technical Issues, and Looming Data 
Gaps Require Focused Attention, GAO-1 2-604 (Washington, D.C.: June 15, 2012); Polar 
Satellites: Agencies Need to Address Potential Gaps in Weather and Climate Data 
Coverage, GAO-1 1-945T (Washington, D.C.: Sept. 23, 2011); Polarorbiting 
Environmental Satellites: Agencies Must Act Quickly to Address Risks That Jeopardize 
the Continuity of Weather and Climate Data, GAO-10-558 (Washington, D C.: May 27, 
2010); Polarorbiting Environmental Satellites: With Costs Increasing and Data Continuity 
at Risk, Improvements Needed in Tri- Agency Decision Making, GAO-09-772T 
(Washington, D.C.: June 17, 2009); and Polarorbiting Environmental Satellites: With 
Costs Increasing and Data Continuity at Risk, Improvements Needed in Th-Agency 
Decision Making, GAO-09-564 (Washington, D.C.: June 17, 2009). 
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and delivering flight-ready instruments to the spacecraft. The Ground 
Project Office, managed by NOAA, oversees the Core Ground System 
contract and satellite data product development and distribution. 

NOAA has made a number of changes to the program since 2006, 
including the removal of certain satellite data products and a critical 
instrument (the Hyperspectral Environmental Suite). In February 2011, as 
part of its fiscal year 2012 budget request, NOAA requested funding to 
begin development for two additional satellites in the GOES-R series. The 
program estimates that the development for all four satellites in the 
GOES-R series is to cost $10.9 billion through 2036. In August 2013, 
NOAA announced that it would delay the launch of the GOES-R and S 
satellites from October 201 5 and February 2017 to the second quarter of 
fiscal year 2016 and the third quarter of fiscal year 2017, respectively. 
These are the current anticipated launch dates of the first two GOES-R 
satellites; the last satellite in the series is planned for launch in 2024. 

In September 2010, we recommended that NOAA develop and document 
continuity plans for the operation of geostationary satellites that include 
the implementation procedures, resources, staff roles, and time tables 
needed to transition to a single satellite, a foreign satellite, or other 
solution. 10 In September 201 1 , the GOES-R program provided a draft 
plan documenting a strategy for conducting operations if there were only 
a single operational satellite. 

In June 2012, we reported that, in order to oversee GOES-R contingency 
funding, senior managers at NOAA should have greater insight into the 
amount of contingency reserves 11 set aside for each satellite in the 
program and detailed information on how reserves are being used on 
both the flight and ground components. We recommended that the 
program assess and report to the NOAA Program Management Council 
the reserves needed for completing remaining development for each 
satellite in the series. We also found that unresolved schedule 
deficiencies remain in portions of the program's integrated master 


10 GAO, Geostationary Operational Environmental Satellites: Improvements Needed in 
Continuity Planning and Involvement of Key Users, GAO-1 0-799 (Washington, D.C.: Sept. 
1, 2010). 

1 1 A contingency reserve provides program managers ready access to funding in order to 
resolve problems as they occur and may be necessary to cover increased costs resulting 
from unexpected design complexity, incomplete requirements, or other uncertainties. See 
GAO, GAO Cost Estimating and Assessment Guide: Best Practices for Developing and 
Managing Capital Program Costs, GAO-09-3SP (Washington, D.C.: Mar. 2009). 
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schedule, including subordinate schedules for the spacecraft and core 
ground system. 12 We recommended that the program address shortfalls 
in schedule management practices, and NOAA has since taken steps to 
improve these practices. We subsequently assessed NOAA’s progress in 
implementing both of these recommendations in our reports being issued 
today. 


The JPSS Program Has Made Progress, but Faces Development 
Challenges, Has Weaknesses in Schedule Quality, and Lacks a 
Comprehensive Contingency Plan 

NOAA has made progress towards JPSS program objectives of 
sustaining the continuity of NOAA’s polar-orbiting satellite capabilities 
through the S-NPP, JPSS-1, and JPSS-2 satellites by (1) delivering 
S-NPP data to weather forecasters and (2) completing significant 
instrument and spacecraft development for the JPSS-1 satellite. 

However, the program has experienced delays on the ground system 
schedules for the JPSS-1 satellite. Moreover, the program is revising its 
scope and objectives to reduce costs and prioritize NOAA’s weather 
mission. 

The JPSS program has made progress on S-NPP since its launch. For 
example, in November 2012 the office completed an interim backup 
command and control facility that could protect the health and safety of 
the satellite if unexpected issues occurred at the primary mission 
operations facility. Also, since completing satellite activation and 
commissioning activities in March 2012, the JPSS program has been 
working to calibrate and validate S-NPP products in order to make them 
precise enough for use in weather-related operations by October 2013. 
While the program office plans to have 18 products validated for 
operational use by the end of September 2013, it is behind schedule for 
other products. Specifically, the program expects to complete validating 
35 S-NPP products by the end of September 2014 and one other product 
by the end of September 2015, almost one and two years later than 
originally planned. 


12 GAO, Geostationary Weather Satellites: Design Progress Made, but Schedule 
Uncertainty Needs to be Addressed, GAO-12-576, (Washington, D C.: June 26, 2012). 




35 


in order to sustain polar-orbiting earth observation capabilities beyond 
S-NPP, the program is working to complete development of the JPSS-1 
systems in preparation for a March 2017 launch date. To manage this 
initiative, the program office organized its responsibilities into two 
separate projects: (1) the flight project, which includes sensors, 
spacecraft, and launch vehicles and (2) the ground project, which 
includes ground-based data processing and command and control 
systems. JPSS projects and components are at various stages of system 
development. The flight project has nearly completed instrument 
hardware development for the JPSS-1 satellite and has begun testing 
certain instruments. Key testing milestones and delivery dates for the 
instruments and spacecraft have generally held constant since the last 
key decision point in July 2012, and both the instruments and the 
spacecraft are generally meeting expected technical performance. Ail 
instruments are scheduled to be delivered to the spacecraft by 2014. 

Also, the flight project completed a major design review for the JPSS-1 
satellite’s spacecraft. 

The JPSS ground project has also made progress in developing the 
ground system components. However, the ground project experienced 
delays in its planned schedule due to issues with the availability of 
facilities required for hardware installation, software development, and 
testing. Consequently, the program has replanned the ground project 
schedule and is merging the next two major software releases. As a 
result, any complications in the merged ground system upgrades could 
affect the system’s readiness to support the JPSS-1 launch date. 

While NOAA is moving forward to complete product development on the 
S-NPP satellite and system development on the JPSS-1 satellite, the 
agency recently made major revisions to the program’s scope and 
planned capabilities and is moving to implement other scope changes as 
it finalizes its plans pending congressional approval of the federal budget. 
We previously reported that, as part of its fiscal year 2013 budget 
process, NOAA was considering removing selected elements of the 
program in order to reduce total program costs from $14.6 billion to $12.9 
billion. 13 By October 2012, NOAA had reduced the program’s scope by, 
among other things, reducing the previously planned network of fifteen 
ground-based receptor stations to two receptor sites at the north pole and 
two sites at the south pole and increasing the time it takes to obtain 
satellite data and deliver it to the end user on JPSS-2 from 30 minutes to 


13 G AO-1 2-604. 
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80 minutes. 14 More recently, as proposed by the administration, NOAA 
began implementing additional changes in the program’s scope and 
objectives in order to meet the agency’s highest-priority needs for 
weather forecasting and reduce program costs from $12.9 billion to $1 1.3 
billion. In this latest round of revisions, NOAA revised the program’s 
scope by, among other things, transferring requirements for certain 
climate sensors to NASA, creating a new Polar Free Flyer program within 
NOAA that would be responsible for missions supporting continued solar 
measurements and user service systems, and reducing the JPSS 
program’s mission life cycle by 3 years — from 2028 to 2025. The changes 
NOAA implemented over the last 2 years will have an impact on those 
who rely on polar satellite data. Specifically, satellite data products will be 
delivered more slowly than anticipated because of the reduction in the 
number of ground stations, and military users may not obtain the variety 
of products once anticipated at the rates anticipated because of the 
removal of their ground-based processing subsystems. As NOAA moves 
to implement these program changes, it will be important to assess and 
understand the impact the changes will have on satellite data users. 

Integration Problems and Other Weaknesses Reduce JPSS Schedule Quality and 
Confidence 

According to our guidance on best practices in scheduling, 15 the success 
of a program depends, in part, on having an integrated and reliable 
master schedule that defines when and how long work will occur and how 
each activity is related to the others. The JPSS program office provided a 
preliminary integrated master schedule in June 2013, but this schedule is 
incomplete. The schedule contains the scope of work for key program 
components, such as the JPSS-1 and JPSS-2 satellites and the ground 
system, and cites linkages to more detailed component schedules. 
However, significant weaknesses exist in the program’s schedule. 
Specifically, about one-third of the schedule is missing logical 
relationships called dependencies that are needed to depict the sequence 
in which activities occur. Complete network logic between all activities is 
essential if the schedule is to correctly forecast the start and end dates of 
activities within the plan. Program documentation acknowledges that this 
schedule is not yet complete and the program office plans to refine it over 


14 ln January 2013, program officials revised this delay to 96 minutes to more precisely 
reflect the time it takes to send products from the ground system to the end users. 

15 GAO, GAO Schedule Assessment Guide: Best Practices for Project Schedules, GAO- 
12-1 20G (exposure draft) (Washington, D.C.: May 30, 2012). 
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time. Until the program office completes its integrated schedule and 
includes logically linked sequences of activities, it will lack the information 
it needs to effectively monitor development progress, manage 
dependencies, and forecast the JPSS-1 satellite’s completion and launch. 

While the program plans to refine its integrated master schedule, three 
component schedules supporting the JPSS-1 mission — VIIRS, the 
spacecraft, and the ground system — varied in their implementation of 
characteristics of high-quality, reliable schedules. Each schedule had 
strengths and weaknesses with respect to sound scheduling practices, 
but VIIRS was a stronger schedule with fewer weaknesses compared to 
the ground system and spacecraft schedules. The following table 
identifies the quality of each of the selected JPSS-1 component 
schedules based on the extent to which they met ten best practices of 
high-quality and reliable schedules. 


Table 1: Assessment of JPSS-1 Component Schedule Quality 

Schedule characteristic or. best practice t o ' r ^ 

Ground system 

Spacecraft. | 

'IIVURS g 

Comprehensive 




Capturing all activities 

9 

3 

3 

Assigning resources to all activities 

a 

9 

3 

Establishing the duration of aii activities 

a 

3 

• 

Well-constructed 

•?§!;:. 



Sequencing all activities 

a 

3 

a 

Confirming that the critical path is valid 

(5 

3 

a 

Ensuring reasonable total float 

a 

3 

a 

Credible 


3 

a 

a 

Conducting a schedule risk analysis 

<5 

3 

a 

Controlled - -jgs'v 

Updating the schedule using actual progress and logic 

3 

a 

• 

Maintaining a baseline schedule 

a 

3 

a 


Source: GAO analysis of dolailed schedules and related documenlalion for the VIIRS instrument, spacecraft, and ground system. 

• —Met: The program office or contractor provided complete evidence that satisfies the entire 
criterion. 

3 = Substantially met: The program office or contractor provided evidence that satisfies a large 
portion of the criterion. 

3 = Partially met: The program office or contractor provided evidence that satisfies about half of the 
criterion. 

(3 = Minimally met: The program office or contractor provided evidence that satisfies a small portion 
of the criterion. 

O = Not met: The program office or contractor provided no evidence that satisfies any of the criterion. 
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The inconsistency in quality among the three schedules has multiple 
causes, including the lack of documented explanations for certain 
practices and schedule management and reporting requirements that 
varied across contractors. Since the reliability of an integrated schedule 
depends in part on the reliability of its subordinate schedules, schedule 
quality weaknesses in these schedules will transfer to an integrated 
master schedule derived from them. Consequently, the extent to which 
there are quality weaknesses in JPSS-1 support schedules further 
constrains the program’s ability to monitor progress, manage key 
dependencies, and forecast completion dates. Until the program office 
addresses the scheduling shortfalls in its component schedules, it will 
lack the information it needs to effectively monitor development progress, 
manage dependencies, and forecast the JPSS-1 satellite’s completion 
and launch. 

The JPSS program office used data from flight project component 
schedules as inputs when it recently conducted a schedule risk analysis 
on the JPSS-1 mission schedule (and launch date) through NASA’s joint 
cost and schedule confidence level (JCL) process. 16 The JCL 
implemented by the JPSS program office represents a best practice in 
schedule management for establishing a credible schedule and reflects a 
robust schedule risk analysis conducted on key JPSS-1 schedule 
components. Based on the results of the JCL, the program office reports 
that its level of confidence in the JPSS-1 schedule is 70 percent and that 
it has sufficient schedule reserve to maintain a launch date of no later 
than March 2017. However, the program office’s level of confidence in the 
JPSS-1 schedule may be overly optimistic for two key reasons. First, the 
model that the program office used was based on flight project activities 
rather than an integrated schedule consisting of flight, ground, program 
office, and other activities relevant to the development and launch of 
JPSS-1 . As a result, the JPSS program office's confidence level 
projections do not factor in the ongoing scheduling issues that are 
impacting the ground project. Second, there are concerns regarding the 
spacecraft schedule's quality as identified above. Factoring in these 
concerns, the confidence of the JPSS-1 satellite’s schedule and projected 
launch date would be lower. Until the program office conducts a schedule 
risk analysis on an integrated schedule that includes the entire scope of 


16 The JCL is a probabilistic analysis that includes, among other things, all cost and 
schedule elements, incorporates and quantifies potential risks, assesses the impacts of 
cost and schedule to date, and addresses available annual resources to arrive at 
development cost and schedule estimates associated with various confidence levels. 
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effort and addresses quality shortfalls of relevant component schedules, it 
will have less assurance of meeting the planned March 2017 launch date 
for JPSS-1. 

NOAA Has Analyzed Alternatives for Addressing Gaps in Satellite Data, but Lacks a 
Comprehensive Contingency Plan 

In recent years, NOAA officials have communicated publicly and often 
about the risk of a polar satellite data gap. Currently, the program 
estimates that there will be a gap of about a year and a half from the time 
when the current Suomi NPP satellite reaches the end of its expected 
lifespan and when the JPSS-1 satellite will be in orbit and operational. 
Satellite data gaps in the morning or afternoon polar orbits would lead to 
less accurate and timely weather forecasting; as a result, advanced 
warning of extreme events — such as hurricanes, storm surges, and 
floods — would be affected. See figure 1 for a depiction of a potential gap 
in the afternoon orbit lasting 1 7 months. 


Figure 1: A Potential Gap in Polar Environmental 
Satellite 


S-NPP 


JPSS-1 


Government and industry best practices call for the development of 
contingency plans to maintain an organization’s essential functions in the 
case of an adverse event and to reduce or control negative impacts from 
such risks. 17 In October 2012, in response to our earlier recommendations 
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One possible scenario: 
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17 See GAO, Year 2000 Computing Crisis: Business Continuity and Contingency Planning, 
GAO/AIMD-IO.1.19 (Washington, D.C.: August 1998); National Institute of Standards and 
Technology, Contingency Planning Guide for Federal Information Systems, NIST 800-34 
(May 2010); Software Engineering Institute, CMMI® for Acquisition, Version 1.3, 
(Pittsburgh, Pa: November 2010). 
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to establish mitigation plans, 18 NOAA established a mitigation plan to 
address the impact of potential gaps in polar afternoon satellite data. This 
plan identifies alternatives for mitigating the risk of a 14- to 18-month gap 
in the afternoon orbit beginning in March 2016, between the current polar 
satellite and the JPSS-1 satellite. However, NOAA did not implement the 
actions identified in its mitigation plan and decided to identify additional 
alternatives. In October 2012, at the direction of the Under Secretary of 
Commerce for Oceans and Atmosphere (who is also the Administrator of 
NOAA), NOAA contracted for a detailed technical assessment of 
alternatives to mitigate the degradation of products caused by a gap in 
satellite data in the afternoon polar orbit. This assessment solicited input 
from experts within and outside of NOAA and resulted in a range of 
alternatives that included relying on existing polar satellites, making 
improvements to the forecast models, and relying on the use of a foreign 
satellite. 

By documenting its mitigation plan and conducting a study on additional 
alternatives, NOAA has taken positive steps towards establishing a 
contingency plan for handling the potential impact of satellite data gaps in 
the afternoon polar orbit. However, NOAA does not yet have a 
comprehensive contingency plan because it has not yet selected the 
strategies to be implemented or established procedures and actions to 
implement the selected strategies, in addition, there are shortfalls in the 
agency’s current plans as compared to government and industry best 
practices, such as not always identifying specific actions with defined 
roles and responsibilities, timelines, and triggers. Moreover, multiple 
steps remain in testing, validating, and implementing the contingency 
plan. NOAA officials stated that the agency is continuing to work on 
refinements to its gap mitigation plan, and that they anticipate issuing an 
updated plan in fall 2013 that will reflect the additional alternatives. While 
NOAA expects to update its plan, the agency does not yet have a 
schedule for adding key elements — such as specific actions, roles and 
responsibilities, timelines, and triggers — for each alternative. Until NOAA 
establishes a comprehensive contingency plan that integrates its 
strategies and addresses the elements identified above to improve its 
plans, it may not be sufficiently prepared to mitigate potential gaps in 
polar satellite coverage. 


’GAO-1 2-604. 
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GOES-R Has Made Development Progress, but Continues to 
Experience Milestone Delays and Weaknesses in Scheduling 
Practices and Contingency Planning 


The GOES-R program has completed its design and made progress in 
building flight and ground components. Specifically, the program 
completed critical design reviews for the flight and ground projects and for 
the overall program between April and November 2012. The GOES-R 
flight components are in various stages leading up to the system 
integration review, with five of six completing a key environmental testing 
review. In addition, the program began building the spacecraft in February 
2013. On the GOES-R core ground system, a prototype for the operations 
module was delivered in late 2012 and is now being used for initial testing 
and training. 

The program has also installed antenna dishes at NOAA’s primary 
satellite communications site, and completed two key reviews of antennas 
at the GOES remote backup site. After the completion of design, and as 
the spacecraft and instruments are developed, NASA plans to conduct 
several interim reviews and tests before proceeding to the next major 
program-level review, the system integration review. 

However, the program has delayed several key milestones. Over the past 
12 to 18 months, both the flight and ground segments experienced delays 
in planned dates for programwide milestones. More recently, in August 
201 3, the program announced that it would delay the launch of the first 
two satellites in the program. Specifically, the launch of the GOES-R 
satellite would be delayed from October 2015 to the quarter ending March 
2016, and that the expected GOES-S satellite launch date would be 
delayed from February 2017 to the quarter ending June 2017. 

The GOES-R program is also experiencing technical issues on the flight 
and ground projects that could cause further schedule delays. For 
example, the electronics unit of the Geostationary Lightning Mapper flight 
instrument experienced problems during testing, which led the program 
office to delay the tests. The program is considering several options to 
address this issue, including using the electronics unit being developed 
for a later GOES-R satellite to allow key components to proceed with 
testing. If the issue cannot be resolved, it would affect the instrument's 
performance. As a result, the program is also considering excluding the 
Geostationary Lightning Mapper from the first GOES-R satellite. It plans 
to make its decision on whether or not to include the instrument in late 
2013. The removal of this instrument would cause a significant reduction 
in the satellite’s functionality. 
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The program has reported that it is on track to stay within its $1 0.9 billion 
life cycle cost estimate. However, program officials reported that, while 
the program is currently operating without cost overruns on any of its 
main components, program life cycle costs may increase by $150 to $300 
million if full funding in the current fiscal year is not received. 

While some improvements have been made, the GOES-R program 
continues to demonstrate weaknesses in the development of component 
schedules, which have the potential to cause further delays in meeting 
milestone timelines. In the time since our previous work on examining 
program schedules in June 2012, it has since improved selected 
practices on its spacecraft and core ground schedules. For example, 
NOAA has since included all subcontractor activities in the core ground 
schedule, and allocated a higher percentage of activities to resources in 
its schedules. As a result of these improvements, the program has 
increased the reliability of its schedules, and also decreased the risk of 
further delaying satellite launch dates due to incorrect schedule data. 

However, the program’s performance on other scheduling best practices 
stayed the same or worsened. For example, both the spacecraft and core 
ground schedules have issues with sequencing remaining activities and 
integration between activities. Without the right linkages, activities that 
slip early in the schedule do not transmit delays to activities that should 
depend on them. Both schedules also have a very high average of total 
float time for detailed activities. 19 Such high values of total float time can 
falsely depict true project status, making it difficult to determine which 
activities drive key milestone dates. Finally, the project’s critical path does 
not match up with activities that make up the driving path 20 on the core 
ground schedule. Without a valid critical path to the end of the schedule, 
management cannot focus on activities that will have a detrimental effect 
on the key project milestones and deliveries if they slip. 

Taken together, delays in key milestones, technical issues, and 
weaknesses in schedule practices could lead to further delays in the 
launch date of the first GOES-R satellite, currently planned to occur by 
March 2016. 


19 Total float time is the amount of time an activity can be delayed or extended before the 
delay affects its successors or the program’s finish date. 

20 A driving path is the longest path of successive activities that drives the finish date for a 
key milestone. The driving path often corresponds to a schedule’s critical path. 
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Launch Delays Increase tire Risk of a Satellite Coverage Gap, and Weaknesses in 
Contingency Plans Increase the Impact of a Coverage Gap 

Launch delays such as the one recently experienced by the GOES-R 
program also increase the time that NOAA is without an on-orbit backup 
satellite. This is significant because, in April 2015, NOAA expects to retire 
one of its operational satellites and move its back-up satellite into 
operations. The recent delay in expected launch of the first GOES-R 
satellite from October 2015 to as late as March 2016 increases the 
projected gap in backup coverage to just short of two years. Also, the first 
satellite is now expected to complete its post-launch testing by 
September 2016, only five months before NOAA expects to retire the 
GOES-1 5 satellite. If launch of the first satellite were to have a further slip 
of more than five months, a gap in satellite coverage could occur. Figure 
2 shows current anticipated operational and test periods for the two most 
recent series of GOES satellites. 


Figure 2: Potential Gap in Geostationary Operational Environmental Satellite Coverage 



Note: The GOES-R and GOES-S launch dates reflect the end of the quarters listed in 
NOAA’s latest launch estimates. Thus, GOES-R is listed as launching by March 2016, 
and GOES-S by June 2017. 

Because of the expected imminent use of the current on-orbit back-up 
satellite, a launch delay to GOES-R would also increase the potential for 
a gap in GOES satellite coverage should one of the two operational 
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satellites (GOES-14 or -15) fail prematurely (see graphic)— a scenario 
given a 36 percent likelihood of occurring by an independent review team. 
Without a full complement of operational GOES satellites, the nation’s 
ability to maintain the continuity of data required for effective weather 
forecasting could be compromised. This, in turn, could put the public, 
property, and the economy at risk. 

The impact of a gap in satellite coverage may also increase based on 
issues with NOAA’s current contingency plans. Government and industry 
best practices call for the development of contingency plans to maintain 
an organization's essential functions in the case of an adverse event. 21 
These practices include key elements such as identifying and selecting 
strategies to address failure scenarios, developing procedures to 
implement selected strategies, and involving affected stakeholders. 

NOAA has established contingency plans for the loss of its GOES 
satellites and ground systems that are generally in accordance with best 
practices. Specifically, NOAA identified failure scenarios, recovery 
priorities, and minimum levels of acceptable performance. NOAA 
provided a final version of its satellite plan in December 2012 that 
included scenarios for three, two, and one operational satellites. It also 
established contingency plans that identify solutions and high-level 
activities and triggers to implement the solutions. 

However, these plans are missing key elements. For example, NOAA has 
not demonstrated that the contingency strategies for both its satellite and 
ground systems are based on an assessment of costs, benefits, and 
impact on users. Furthermore, NOAA did not work with the user 
community to address potential reductions in capabilities under 
contingency scenarios or identify alternative solutions for preventing a 
delay in the GOES-R launch date. In addition, while NOAA’s failure 
scenarios for its satellite system are based on the number of available 
satellites— and the loss of a backup satellite caused by a delayed GOES- 
R launch would fit into these scenarios — the agency did not identify 
alternative solutions or time lines for preventing a GOES-R launch delay. 
Until NOAA addresses the shortfalls in its contingency plans and 
procedures, the plans may not work as intended in an emergency and 


21 See GAO, Year 2000 Computing Crisis: Business Continuity and Contingency Planning, 
GAO/AIMD-IO.1.19 (Washington, D.C.: August 1998); National Institute of Standards and 
Technology, Contingency Planning Guide for Federal Information Systems, NIST 800-34 
(May 2010); Software Engineering Institute, CMMI® for Acquisition, Version 1.3, 
(Pittsburgh, Pa: November 2010). 
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satellite data users may not obtain the information they need to perform 
their missions. 


Implementation of Recommendations Should Help Mitigate Program 
Risks 

Both the JPSS and GOES-R programs continue to carry risks of future 
launch delays and potential gaps in satellite coverage; implementing the 
recommendations in our accompanying reports should help mitigate 
those risks. In the JPSS report being released today, we recommend, 
among other things, that NOAA 

• establish a complete JPSS program integrated master schedule that 
includes a logically linked sequence of activities; 

• address the shortfalls in the ground system and spacecraft 
component schedules outlined in our report; 

• after completing the integrated master schedule and addressing 
shortfalls in component schedules, update the joint cost and schedule 
confidence level for JPSS-1, if warranted and justified; and 

• establish a comprehensive contingency plan for potential satellite data 
gaps in the polar orbit that is consistent with contingency planning 
best practices identified in our report. The plan should include, for 
example, specific contingency actions with defined roles and 
responsibilities, timelines, and triggers; analysis of the impact of lost 
data from the morning orbits; and identification of opportunities to 
accelerate the calibration and validation phase of JPSS-1. 

In the GOES-R report being released today, we recommend, among 
other things, that NOAA 

• given the likely gap in availability of an on-orbit GOES backup satellite 
in 2015 and 2016, address the weaknesses identified in our report on 
the core ground system and the spacecraft schedules. These 
weaknesses include, but are not limited to, sequencing all activities, 
ensuring there are adequate resources for the activities, and 
conducting a schedule risk analysis and 

• revise the satellite and ground system contingency plans to address 
weaknesses identified in our report, including providing more 
information on the potential impact of a satellite failure, identifying 
alternative solutions for preventing a delay in GOES-R launch as well 
as time lines for implementing those solutions, and coordinating with 
key external stakeholders on contingency strategies. 
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On both reports, NOAA agreed with our recommendations and identified 
steps it is taking to implement them. 


In summary, NOAA has made progress on both the JPSS and GOES-R 
programs, but key challenges remain to ensure that potential gaps in 
satellite data are minimized or mitigated. On the JPSS program, NOAA 
has made noteworthy progress in using S-NPP data in weather forecasts 
and developing the JPSS-1 satellite. However, NOAA does not expect to 
validate key S-NPP products until nearly 3 years after the satellite’s 
launch, and there are remaining issues with the JPSS schedule that 
decrease the confidence that JPSS-1 will launch by March 2017 as 
planned. On the GOES-R program, progress in completing the system’s 
design has been accompanied by continuing milestone delays, including 
delays in the launch dates for both the GOES-R and GOES-S satellites. 
The potential for further milestone delays also exists due to remaining 
weaknesses in developing and maintaining key program schedules. 
Faced with an anticipated gap in the polar satellite program and a 
potential gap in the geostationary satellite program, NOAA has taken 
steps to study alternatives and establish mitigation plans. However, the 
agency does not yet have comprehensive contingency plans that identify 
specific actions with defined timelines, and triggers. Until NOAA 
establishes comprehensive contingency plans that addresses these 
shortfalls, its plans for mitigating potential gaps may not be effective in 
avoiding significant impacts to its weather mission. 


Chairman Broun, Chairman Stewart, Ranking Member Maffei, Ranking 
Member Bonamici, and Members of the Subcommittees, this completes 
my prepared statement. I would be pleased to respond to any questions 
that you may have at this time. 
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Chairman Broun. Thank you, Mr. Powner. 

Now, Ms. Kicza, you are recognized for five minutes. 

TESTIMONY OF MS. MARY KICZA, 

ASSISTANT ADMINISTRATOR, 

SATELL I TE AND INFORMATION SERVICES, 

NATIONAL OCEANIC AND ATMOSPHERIC ADMINISTRATION 

Ms. Kicza. Good morning, Chairman Stewart and Broun, Rank- 
ing Members Bonamici and Maffei, and Members of the Sub- 
committees. I am pleased to join Mr. Watkins and Mr. Powner to 
provide an update on the JPSS and GOES-R series programs. 

I am proud to report that JPSS and GOES-R series continue to 
meet their key milestones. For the SUOMI-NPP mission, NOAA 
assumed operational control of the satellite in February 2013. 
Suomi has achieved over 99 percent data availability and its high 
resolution sounder data has been incorporated into weather service 
operational models. JPSS-1 remains on track for launch in second 
quarter Fiscal Year 2017. The instruments are built and now un- 
dergoing testing. The spacecraft is being built. Data products are 
being calibrated and validated and the ground systems are being 
upgraded. With a decision to focus JPSS on NOAA’s critical weath- 
er mission, we have reduced the JPSS lifecycle cost to $11.3 billion 
and accelerated the JPSS-2 to launch the first quarter of Fiscal 
Year 2022. JPSS-2 instruments and spacecraft acquisitions are now 
underway. 

For GOES-R, four of six instruments have completed environ- 
mental testing and the spacecraft bus has completed its critical de- 
sign review. Significant progress has been made on the ground sys- 
tem with installation now complete for four of six antennas at Wal- 
lops Island, VA and West Virginia. GOES-R is on track for its sec- 
ond quarter Fiscal Year 2016 launch. 

While the title of this hearing would lead one to believe other- 
wise, management and oversight of these critical programs is func- 
tional. In response to recent review recommendations, the Depart- 
ment of Commerce, NOAA, and NASA have streamlined oversight 
and management decision-making processes, documented roles and 
responsibilities, and instituted a reporting process which has been 
well received. 

Within JPSS, the NOAA and NASA systems engineering per- 
sonnel have been integrated into a single team, which is recognized 
as a cohesive high-performing unit. Within NOAA/NESDIS, we 
have added an enterprise-level systems engineering function and 
begun implementation of common ground services. Both efforts are 
already producing results which serve to reduce future costs. 

The NOAA/NASA partnership remains robust. The significant 
progress on JPSS and GOES-R reinforces the 2010 Administration 
decision to return to the partnership that has built and operated 
our Nation’s operational weather satellites for more than 40 years. 
This partnership capitalizes on the strengths of both organizations 
to develop and operate our weather satellites enabling delivery of 
products and services critical to our weather forecasts. 

Our NOAA/NASA team relies heavily on our industry partners. 
Contractors at locations across the Nation are working to bring 
JPSS and GOES-R to fruition. I congratulate them for their sue- 
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cesses to date, particularly with SUOMI-NPP and thank them for 
their dedication to building next -generation systems on time and 
within budget. 

We remain closely connected to our user community and appre- 
ciate the GAO’s recommendation to strengthen these connections. 
Concerns about a possible observational gap has been a common 
theme among our users. I assure you, maintaining observational 
continuity remains our singular focus, and to that end, we remain 
intent on keeping our on-orbit assets operating safely, delivering 
next-generation capabilities on or ahead of schedule, and imple- 
menting approaches to mitigate the impact of the gap should one 
occur. 

Louie Uccellini, my counterpart at the National Weather Service, 
understands the importance of satellite data for the national 
weather forecasting enterprise. We both recognize, however, this 
enterprise includes contributions from academia, where much of 
the research and development occurs; the private weather fore- 
casting sector, which provides avenues for dissemination of weather 
products; and federal, state, and local emergency managers who 
serve as first responders when severe weather strikes. 

NOAA also relies on our relationships with our international 
partners to meet our requirements. In this regard, we recently 
signed a long-term agreement with EUMETSAT, our European 
counterpart, to ensure continuity of our partnership to share space- 
based observational data. 

Finally, I turn my attention to Congress. The ability of our teams 
to achieve sustained observations is only possible with your contin- 
ued support. In addition to providing oversight, we depend on you 
to provide the budgets required to implement next-generation sys- 
tems and to do so in a manner in which we can plan effectively. 
We are grateful for your support. 

We understand the difficult fiscal challenges our Nation faces 
and we have worked hard to minimize the impacts to our launch 
schedules in light of sequester reductions. We appreciate the rec- 
ommendations offered by the GAO and by other external review 
bodies and we will respond to them. We recognize that collectively 
we all share the same objective, and that is mission success. 

Thank you and I am happy to answer your questions. 

[The prepared statement of Ms. Kicza follows:] 
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Good morning Chairmen Stewart and Broun, Ranking Members Bonamici and Maffei, and 
Members of the Committee. I am Mary Kicza, the Assistant Administrator of NOAA’s National 
Environmental Satellite, Data, and Information Service (NESDIS). Thank you for the 
opportunity to join Mr. David Powner from the Government Accountability Office (GAO), and 
Mr. Marcus Watkins from the National Aeronautics and Space Administration (NASA) at 
today’s hearing. While I will focus my remarks on NOAA’s Joint Polar Satellite System (JPSS) 
and Geostationary Operational Environmental Satellite-R (GOES-R) Series Programs, 1 am 
ready to address questions on NOAA's entire satellite acquisition portfolio. 

NOAA’s mission to provide science, service, and stewardship to the Nation is fundamentally 
dependent on observations of our environment. These observations arc the backbone of NOAA’s 
predictive capabilities. NOAA must ensure operational weather, ocean, climate, and space 
weather data are available seven days a week, 24 hours a day, to address our Nation’s critical 
needs for timely and accurate forecasts and warnings of solar storms and severe weather, such as 
hurricanes, flash floods, tsunamis, winter storms, and wildfires. Of the data actually assimilated 
into NOAA’s National Weather Service (NWS) numerical weather prediction models that are 
used to produce the longer term weather forecasts three days and beyond, over 95 percent comes 
from satellites, of which over 80 percent are from polar-orbiting satellites. These polar-orbiting 
satellites include NOAA’s Polar-orbiting Operational Environmental Satellite (POES), Suomi 
National Polar-orbiting Partnership (Suomi NPP) satellite, and NASA Earth Observing Satellites 
(EOS) in the afternoon orbit, and the European Metop satellites which fly in the mid-morning 
orbit. GOES satellites, along with Doppler Radar, assist operational weather forecasters with 
current and short-term forecasting abilities (i.e., weather that is occurring now up to three days in 
the future) and severe weather warning forecasts. 

The American public and the commercial sector expect that they can continue to rely on 
receiving accurate, reliable, and timely weather information from NWS. The growing private 
weather sector, which delivers specialized weather information, is another consumer reliant on 
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receipt of these data. NOAA’s satellites are an integral part of the observational infrastructure 
that supports these NWS and commercial sector forecasting capabilities. 

My testimony today will focus on the progress that NOAA, with NASA as our acquisition agent, 
is achieving in developing the Nation’s next generation geostationary and polar-orbiting satellite 
systems, the GOES-R Series and JPSS Programs. While these geostationary and polar-orbiting 
systems provide the backbone of data that drive the NWS numerical weather prediction models, 
NOAA augments its observational needs by leveraging data from research satellites (e.g., NASA 
EOS and Advanced Composition Explorer); by using data from Department of Defense satellites 
(e.g.. Defense Meteorological Satellite Program); by purchasing data from the commercial sector 
(e.g., lightning data and space-based Synthetic Aperture Radar); by implementing international 
agreements to ingest data from partner organizations (e.g., Metop data, Constellation Observing 
System for Meteorology, Ionosphere and Climate (COSMIC) data); and by jointly procuring 
satellite systems through domestic (e.g.. Deep Space Climate Observatory (DSCOVR) 
refurbishment) and international partnerships (e.g., Jason-3 acquisition). 

Over the past five years, NOAA has made strategic and deliberate steps to return to an over 40 
year partnership with NASA for acquisition of NOAA’s operational satellites. This renewed 
partnership leverages the acquisition and developmental expertise of NASA to provide systems 
engineering and procurement support on a fully reimbursable basis. This decision continues a 
partnership that has supported an unprecedented series of successful launches of NOAA’s 
geostationary and polar-orbiting operational satellites and enables in-depth technical 
management and systems engineering oversight of NOAA’s satellite acquisition portfolio. 

I am pleased to report this partnership continues to enable us to stabilize management structures, 
staffing, requirements, and program oversight. This has led to the completion of key program 
milestones, and gives us confidence that we will meet the cost, schedule, and performance 
milestones that lie ahead. 

Our recurring challenge is being able to plan and execute our programs in the difficult budget 
environment we all face at this time. This requires the timely receipt of appropriated funds of the 
requested amounts, allowing these critical satellite systems to maintain their current development 
cadence, thereby ensuring the GOES-R Series and JPSS satellites are successfully launched and 
operating before the current legacy satellites cease to provide useful data. Without this, NOAA 
cannot guarantee that cost, schedule, and performance commitments can be met. 

Over the past year, we were reviewed by David Powner’s team, the Information Technology 
Team, at the GAO, the Department of Commerce Office of Inspector General (OIG), and 
independent review teams comprised of eminent aerospace experts. While the reviews looked at 
many specific areas of concern, all reviews urged us to remain focused on maintaining the 
continuity of our observational capability and being prepared to mitigate the impacts of a gap in 
coverage. The reviewers were mindful of the immediate and devastating impacts to the Nation 
that a gap in coverage would bring, starting with degraded forecast quality and skill, which could 
place lives and property at risk from severe weather events. We concur with the 
recommendations from these groups and are working to ensure the GOES-R Series and JPSS 
satellite development continues. The Committee has expressed concern that GAO added 
NOAA’s satellite acquisition of the GOES-R Series and JPSS Programs to its Biennial High Risk 
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List due to the risk of gaps in weather observations. The steps that NOAA has been taking over 
the years to implement the OIG and GAO recommendations, and will take to implement these 
most current recommendations will address many of the root causes that the GAO High Risk 
report emphasized, specifically, the potentials for gaps in coverage and the impact on weather 
forecasts and on the customers and users of NOAA’s satellite data. Additionally, the 2012 
Independent Review Team (IRT) led by Thomas Young also provided invaluable 
recommendations that informed NOAA’s FY 2014 Budget request and underscored the 
importance of refocusing the JPSS Program on a weather mission. 

Progress on the GOES-R Series Program 

The GOES-R Series Program is NOAA’s next-generation geostationary environmental satellite 
constellation. Geostationary environmental satellites are our observational sentinels in space, 
providing constant watch for severe weather such as hurricanes, severe thunderstorms, flash 
floods, and wildland fires in the Western Hemisphere. With two geostationary satellites always 
in operation (GOES-East and GOES-West) and an on-orbit spare, we are able to track severe 
weather from the coast of Africa across to most of the Pacific basin. The GOES satellites 
complement in situ observational systems such as NOAA’s Doppler Radar network, NOAA’s 
Hurricane Hunters, and ocean buoys to provide NWS forecasters with near real-time data used to 
support operational weather forecasts. 

GOES-R Series Program Content. The GOES-R Series Program content remains unchanged 
since the 2012 bearing, and progress is being made on the development of all the instruments 
which will provide continuity and needed enhancements of required weather and space weather 
data: 

• Advanced Baseline Imager (ABI) 

• Geostationary Lightning Mapper (GLM) 

• Space Environmental In-Situ Suite (SEISS) 

• Extreme Ultra Violet / X-Ray Irradiance Sensor (EXIS) 

• Solar Ultra Violet Imager (SUVI) 

• Magnetometer 

GOES-R Series Program Progress. The GOES-R Series Program has made significant 
progress in its development, including: 

• Delivery of the first GOES-R instrument, the Extreme Ultraviolet and X-ray Irradiance 
Sensor (EXIS) Flight Model 1 (FM1), which is ready to be integrated onto the GOES-R 
spacecraft. 

• Completion of environmental testing of the Advanced Baseline Imager (ABI), the Solar 
Ultraviolet Imager (SUVI), and the Space Environment In-Situ Suite (SEISS). The ABI, 
SUVI, and SEISS will all be available for integration with the spacecraft by the end of 
2013. 

• Progress with the remaining GOES-R instruments, the Geostationary Lightning Mapper 
(GLM) and Magnetometer, which are on track for delivery in mid-2014. 

• Significant progress on the development of the GOES-R spacecraft bus, which is on track 
to be available for instrument integration in 2014. 
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• Delivery of the first significant release of Core Ground System to the Government’s 
Mission Operations Support Team located at the NOAA Satellite Operations Facility in 
Suitland, Maryland. 

• Progress with the assembly and installation of GOES-R antenna structures at the Wallops 
Command and Data Acquisition Station in Wallops Island, Virginia and at the Remote 
Backup Unit (RBU) in Fairmont, West Virginia. These efforts are proceeding on 
schedule with four of six new antenna structures already complete. 

GOES-R Series Program Cost. The GOES-R Series Program Baseline Report, dated February 
8, 2013, reported to Congress that the lifecycle cost (LCC) for the GOES-R Series Program is 
$10,860 billion for four satellites. Maintaining the GOES-R Series Program at the LCC reflected 
in the Baseline Report is dependent on NOAA receiving appropriations as requested in the 
Administration’s annual budget requests. Given sequestration and rescission impacts, the FY 
2013 enacted appropriations bill did not provide the level of funding required for the GOES-R 
Series Program as outlined in the Baseline Report. The GOES-R Series Program is still refining 
the cost impact of the FY 2013 appropriations bill to the LCC. 

GOES-R Series Schedule. The GOES-R Series Program recently completed an assessment of 
the impact on the schedule due to the $54 million reduction from the sequestration and rescission 
included in the enacted FY 2013 appropriations. The effects from these budget reductions 
continue to be assessed. The GOES-R Series Program continues, however, to work aggressively 
in order to have GOES-R and GOES-S ready as early as possible. We are confident that we can 
meet these adjusted launch date commitments for GOES-R and GOES-S given timely receipt of 
requested funding amounts moving forward. 

2013 GAO Review of the GOES-R Series Program 

NOAA was provided an opportunity to review the draft GAO recommendations and NOAA 
concurs with the four GAO recommendations for the GOES-R Series Program reflected in that 
document. We will review the final report and the recommendations contained therein and will 
work to address them. 

These recommendations include direction to: 

• include information and methodology for calculating the amount of reserve funding for 
each of the four satellites in the program in regular briefings to NOAA senior executives; 

• improve sequencing of all activities to ensure there are adequate resources for the 
activities, and conduct a schedule risk analysis on the core ground systems and spacecraft 
schedules; 

• improve communications with internal and external satellite data users on changes in 
GOES-R requirements; 

• revise the satellite and ground system contingency plans to provide more information on 
the potential impact of a satellite failure, identifying alternative solutions for preventing a 
delay in GOES-R launch as well as timelines for implementing those solutions, and 
coordinating with key external stakeholders on contingency strategies. 

With sufficient appropriations, as noted above, we will minimize the possibility of a gap of 
coverage in the geostationary orbit. 
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2013 PIG Review of the GOES-R Series Program 

The OIG completed its most recent review of the GOES-R Series Program in April 2013. NOAA 
has developed action plans which it is implementing in response to these findings and 
recommendations. 

Recommend that the NOAA Deputy Under Secretary for Operations: 

1. Develop a comprehensive set of tradeoff approaches to mitigate launch delays and 
communicate approaches to stakeholders and users. 

2. Keep stakeholders and users informed of tradeoffs made to meet the launch date. 

3. Direct NESDIS to report periodically on the adequacy of program systems engineering 
integration and NASA systems engineering support. 

Recommend that the NOAA Assistant Administrator for NESDIS ensure that NASA: 

4. Effectively validates contractors’ proposals and subsequent plans, to verify that technical 
designs meet readiness requirements per NASA standards. 

5. Modifies contract award-fee structures to reduce award fee percentages and clearly 
articulates how scores should be adjusted based on the magnitude of cost overruns. 

6. Adjusts future award fees to be more commensurate with contractor performance. 

Recommend that the NOAA Deputy Under Secretary for Operations: 

7. Direct the development of a policy for managing undefmitized contract actions to definitize 
change orders in the shortest practicable time. 

We believe that implementing these recommendations will improve our overall management of 
the GOES-R Series Program. 

2012 IRT Review 

While the IRT provided an overall review of NOAA’s satellite portfolio, the team stated that the 
GOES-R model of governance is most consistent with the principles for success, and that its 
program requirements were well defined for its weather and space weather mission. There were 
other recommendations such as streamlining reporting and the decision making processes that 
have benefited the GOES-R Series Program. The IRT cautioned that the GOES-R gap required 
vigilance and management attention. 

Progress on the JPSS Program 

NOAA’s Polar-orbiting Operational Environmental Satellite (POES) series provides full global 
coverage for a broad range of weather and environmental monitoring applications. Placed in the 
afternoon orbit, NOAA POES and NASA EOS satellites are crucial for NWS’s three to seven 
day weather forecasts and environmental modeling efforts. The current POES satellite, NOAA- 
19, was launched in early 2009 with a design life lasting until the second quarter of FY 2013. 
While it continues to operate, it is beginning to demonstrate some sensor deterioration. The 
Suomi NPP satellite, which was launched in October 201 1 with a design life lasting until the first 
quarter of FY 2017 and is now operated by NOAA as a part of the JPSS Program, is providing 
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operational data to the NWS weather forecast models. Both NOAA-19 and Suomi NPP are 
providing coverage for the afternoon orbit. The European Metop satellite constellation (Metop A 
and Metop B), which flies in the mid-morning orbit, is also robust and NOAA uses these data in 
its numerical weather prediction models. 

JPSS Program Content. The JPSS Program, as described in the President’s FY 2014 Budget 
request, consists of three satellites: Suomi NPP, JPSS-1 and JPSS-2, and the associated ground 
system. 

The JPSS Program has been refocused to support a weather mission and will fly the following 
core instruments: 

• Advanced Technology Microwave Sounder (ATMS) 

• Cross-track Infrared Sounder (CrlS) 

• Visible Infrared Imaging Radiometer Suite (VI1RS) 

• Ozone Mapping and Profile Suite (OMPS)-Nadir 

While JPSS-1 will fly the Clouds and the Earth’s Radiant Energy System (CERES) instrument, 
responsibility for funding the development of the follow on instrument has been transferred to 
NASA. NASA will also assume responsibility for funding continuity of the second Total Solar 
and Spectral Irradiance Sensor (TSIS) and the OMPS-Limb instruments. The responsibility for 
providing spacecraft bus and rideshare for the first TSIS, Satellite-assisted Search and Rescue 
instrument (SARSAT), and the Advanced Data Collection System (A-DCS) has been transferred 
out of the JPSS portfolio to a new NOAA program entitled Polar Free Flyer. 

JPSS Program Progress. Over the past year, the JPSS Program has achieved the following 
successes: 

• Completed and passed the DOC Milestone 2/3 and Key Decision Point (KDP)-I reviews 
which documented the cost and schedule commitment for accomplishing the 
development and operation of JPSS. 

• Submitted, as part of the President’s FY 2014 Budget request, a JPSS Program focused 
on NOAA’s weather mission, revising the total program LCC to $1 1.3 billion. 

• Completed reconciliation with a DOC Independent Cost Estimate, which validated the 
revised program cost. 

• Completed JPSS-1 Mission KDP-C in July 2013, which baselined its cost, performance, 
and schedule to launch in early 2017. 

• Transitioned Suomi NPP Ground Operations from NASA to NOAA in February 2013. 

• Completed assembly of all JPSS-1 instruments and advanced them to instrument level 
test phase. 

JPSS Program Cost. Since the 2012 hearing before this Committee, the Administration has 
reduced the scope and content of the JPSS program to more narrowly focus on the weather 
mission. This reduction was achieved by transferring responsibility for non-weather instruments 
to NASA and other programs within NOAA, trimming content, and improving efficiency. This 
has resulted in a reduction of the JPSS Program LCC from $12.9 billion as reflected in the 
President’s FY 2013 Budget request to the current LCC of $1 1.3 billion. This new cost 
commitment was affirmed by the recent KDP-I approval. That figure consists of the prior year 
costs of $2.5 billion legacy costs from the earlier NPOESS program and $2.6 billion appropriated 
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from FY 20 1 0 through FY 20 1 3 to implement the transition and beginning of the JPSS program, 
and a commitment of $6.2 billion from FY 2014 to FY 2025. The latter total is required to 
operate the Suomi NPP satellite, finish building the JPSS-1 satellite, build the JPSS-2 satellite, 
continue development of the ground system, and perform the activities required to launch JPSS-1 
and JPSS-2 and operate and sustain all three satellite missions in the JPSS portfolio, i.e., Suomi 
NPP, JPSS-1, and JPSS-2. 

JPSS Schedule. The launch schedule for the JPSS-1 satellite in the second quarter of FY 2017 
remains unchanged since the 2012 hearing. We have recently completed additional analyses 
which indicate that we are in a much better position to meet this schedule based on the progress 
made on ground and flight development and based on full funding provided in the FY 2014 
Flouse and Senate Marks. With respect to the JPSS-2 launch readiness date, with the refocusing 
of the JPSS Program to weather mission, NOAA has rephased out-year funding to bring forward 
the JPSS-2 launch to the first quarter of FY 2022. 

2013 GAO Review of the JPSS Program 

NOAA was provided an opportunity to review the draft GAO recommendations and NOAA 
concurs with the five GAO recommendations for the JPSS Program reflected in that document. 
We will review the final report and the recommendations contained therein and will work to 
address them. 

The recommendations include direction to: 

• track the extent to which groups of satellite data users are using Suomi NPP and JPSS 
products and obtain feedback on these products; 

• establish a complete JPSS Program integrated master schedule that includes a logically 
linked sequence of activities; 

• address the shortfalls in the ground system and spacecraft component schedules outlined 
in the report; 

• update the joint cost and schedule confidence level for JPSS- 1 , if warranted and justified 
after completing the integrated master schedule and addressing shortfalls in component 
schedules; and 

• establish a comprehensive contingency plan for potential satellite data gaps in the polar 
orbit that is consistent with the contingency planning best practices identified in this 
report. The plan should include, for example, specific contingency actions with defined 
roles and responsibilities, timelines, and triggers; analysis of the impact of lost data from 
the morning orbits, and identification of opportunities to accelerate the calibration and 
validation phases of JPSS-1. 

Refocusing the JPSS Program to a weather mission and moving content to other programs has 
improved our confidence on meeting the second quarter FY 201 7 launch readiness date for the 
JPSS-1 satellite, thereby minimizing the possibility of gaps in data coverage noted in the GAO’s 
“High Risk” report. While there is still a risk of a gap in coverage, recent analyses and 
assessments have increased our confidence that we will launch JPSS-1 in the second quarter of 
FY 2017. This, coupled with a rigorous management regime for the Suomi NPP satellite to 
preserve operating life, gives us confidence that if the satellite continues to perform as expected, 
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we will significantly reduce risk of a gap of coverage in the afternoon orbit. However, sufficient 
funding is required to ensure that we maintain the current acquisition schedule. 

2013 OIG Review of the JPSS Program 

The OIG has not yet completed its 2013 review. The JPSS Program continues to provide full and 
open access to the employees and records to the OIG as they carry out their review. We remain 
ready to review their findings and recommendations. 

2012 IRT Review 

The IRT findings and recommendations were organized in five areas of concern: 

1. Oversight and Decision Process 

2. Governance 

3. JPSS Gap 

4. Programs, and 

5. Budget 

Significant changes have been implemented at the Department of Commerce, NOAA, and 
NASA in response to the IRT recommendations. Most notably, the JPSS program, as reflected 
in the President’s FY 2014 Budget request, was modified to focus on NOAA’s weather mission, 
with the JPSS-2 schedule for launch accelerated. Oversight, decision processes and governance 
have been both streamlined and clarified. The DOC, NOAA, and NASA teams are currently in 
the process of reviewing with the IRT our responses to their recommendations. 

Looking to the Future 

As we look to the future, NOAA is aware that the challenges we face require examining and 
reaffirming the core activities that the Government must provide and excel at, while looking at 
possible roles that partnership with the commercial sector and international community can 
provide. For example, this Committee has issued a challenge to NOAA to extend tornado 
warning lead times to one hour. As we work to address the fundamental warning paradigm shift 
this challenge would entail, we will require input from the entire NOAA enterprise. As a major 
data provider for weather forecasting, NESDIS is working with NWS and NOAA’s Office of 
Oceanic and Atmospheric Research to assess the best means of approaching this challenge from 
scientific, technological, and human behavioral dimensions. 

A first and crucial step towards meeting this challenge is to minimize any potential for gaps in 
coverage between the handoff from the current capabilities that NOAA’s satellite constellation 
provide to the next generation GOES-R and JPSS Programs. In addition, NOAA remains focused 
on retaining our current forecasting skill and making incremental improvements towards 
providing as much advance warning as we can to protect lives and safeguard property from 
severe weather events. 

The importance of NOAA’s relationship with the aerospace industry is another integral aspect in 
meeting such challenges. Most of the instruments, all of the spacecraft buses, and much of the 
ground systems and data processing capabilities that will support the GOES-R Series and JPSS 
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Programs are being developed by the aerospace industry under contract to either NASA or 
NOAA. Moreover, NOAA is considering commercial rideshare opportunities for the first TS1S 
instrument, satellite assisted search and rescue (SARSAT) and the Advanced Data Collection 
System (A-DCS) instruments. 

On the international front, NOAA continues to support and strengthen international partnerships 
that help us to maintain continuity of geostationary and polar-orbiting satellite observational 
capability. To that end, I offer the following important updates: 

• NOAA signed a new agreement with its European operational satellite counterpart, the 
European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT) that 
provides a broad policy framework for all of its wide-ranging cooperative activities. Building 
on a 30-year relationship, this agreement commits both to continued cooperation in the areas 
of geostationary backup support, joint ocean altimetry satellite development and operation 
(Jason series), and our JPSS, whereby NOAA and EUMETSAT each operate a polar-orbiting 
satellite in one of the two key orbits required for weather forecasting (NOAA will operate 
JPSS in the "afternoon" orbit). 

• NOAA is working with the Japan Aerospace Exploration Agency (JAXA) to receive and 
process data from its first Global Change Observation Mission-Water (GCOM-W1) satellite, 
which carries the Advanced Microwave Scanning Radiometer (AMSR-2) instrument. These 
data help NOAA conduct assessments of precipitation, water vapor amounts, wind velocity 
above the ocean, sea surface temperature, water levels on land areas, and snow depths. 

• Partnerships with the Canadian and French Space Agencies have been reaffirmed, with these 
agencies providing the satellite-assisted search and rescue (SARSAT) and the Advanced 
Data Collection System (A-DCS) instruments planned for launch by the NOAA Polar Free 
Flyer Program. 

• NOAA has reaffirmed partnerships with our European and Japanese space partners for back- 
up support in the event of a catastrophic loss of NOAA GOES or POES/Suomi NPP 
satellites. 

With funds provided by the Public Law 113-2, “Disaster Relief Appropriations Act of 2013,” 
NOAA is implementing a number of strategic actions designed to make its weather forecasting 
enterprise more robust in the face of the possibility of a gap in polar-orbiting weather data. These 
activities seek to make better use of existing data, take advantage of new data sources planned in 
the future, improve operational high performance computing capacity, and improve the 
assimilation of data into weather prediction models, including hurricane models. The goal is to 
minimize the impact of a gap in coverage should it become a reality. While none of these 
activities, individually or collectively, can totally replace a lack of JPSS data, they represent the 
positive actions NOAA can take to mitigate the loss of these data. Should a data gap not occur, 
these investments will nonetheless improve NOAA’s ability to use existing data, thus improving 
weather forecasts. These actions are being taken in addition to the steps NOAA is taking to 
ensure that JPSS and GOES-R Series satellite development continue as planned. 

Meeting the customers’ needs remains the most important part of this acquisition process. As the 
GOES-R Series Program enters the phase where the first satellite will be launched, it has ramped 
up outreach and interaction with the NWS and external weather forecasting communities to 
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inform these current users of the advances that GOES-R data will provide and how it will assist 
weather forecasters. 

NOAA is using the Suomi NPP data to demonstrate the significant enhancements that these data 
are providing compared to the POES data currently being provided by NOAA-19 and NASA 
EOS satellites. This overlap of coverage allows users to characterize the utility of Suomi NPP 
data with the assurance of having the NOAA-19 and NASA EOS data on-hand to meet their 
immediate mission requirements. 

We are cognizant that each day is a day closer to the eventual retirement of the current legacy 
satellites: the GOES-N Series, NOAA-19 and the NASA research satellites. This reality 
underscores the urgency that we must maintain the current development schedule to ensure that 
the first JPSS satellite is launched no later than the second quarter of FY 20 1 7. 

We rely on your continued support to ensure that these critical programs are fully funded in FY 
2014 and beyond. 

Conclusion 


I will conclude by reaffirming that the NOAA-NASA partnership is strong and is supporting the 
good progress that the GOES-R Series and JPSS Programs are making. Stability of funding in 
FY 2014 and beyond is critical for meeting developmental milestones that will allow these 
programs to meet their launch dates. NOAA shares the concern of the Congress that gaps in 
coverage would significantly impact our ability to provide the weather coverage that the 
American public and commerce rely on. NOAA and the Department of Commerce thank the 
GAO for the very important contributions they are making to these programs. Mr. Powner and 
his team’s recommendations offer us the opportunity for continuous improvement as we move 
forward to maintain the continuity of the operational environmental satellites that are so crucial 
to protecting American lives and property. Further, we express our appreciation to the members 
of the IRT and the OIG staff who have also provided significant and valuable review and 
recommendations. We accept their recommendations and will be responsive to them. 

Finally, I wish to say that NOAA values the long-standing interest by the Committee and its staff 
regarding NOAA’s satellite program. We understand the difficult fiscal environment that we find 
ourselves in and appreciate the Congressional support to ensure that these critical national 
programs are supported to the maximum extent possible. 1 am happy to answer any questions 
you may have. 
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Ms. Kicza received her Bachelors Degree in Electrical and Electronics Engineering from California State 
University and a Masters Degree in Business Administration from the Florida Institute of Technology. 


61 


Chairman Broun. Thank you, Ms. Kicza. 

Now, Mr. Watkins, you are recognized for five minutes. 

TESTIMONY OF MR. MARCUS WATKINS, 

DIRECTOR, JOINT AGENCY SATELLITE DIVISION, 
NATIONAL AERONAUTICS AND SPACE ADMINISTRATION 

Mr. Watkins. Mr. Chairman and Members of the Subcommittee, 
thank you for the opportunity to appear today to provide you infor- 
mation regarding the NASA role in, and commitment to, NOAA’s 
Joint Polar Satellite System, also referred to as JPSS, and the Geo- 
stationary Operational Environmental Satellite-R Series, or GOES- 
R, programs. The JPSS and GOES-R programs are critical to the 
Nation’s weather forecasting system, environmental monitoring, 
and research activities. 

NASA and NOAA have been partners for more than 40 years in 
developing the Nation’s polar and geosynchronous weather sat- 
ellites. With the President’s direction in 2010, NASA and NOAA re- 
turned to this successful partnership for JPSS. The NASA program 
office for JPSS has been established and is fully staffed. NOAA and 
NASA have established joint agency-level program management 
councils to oversee JPSS, and have integrated their decision-mak- 
ing processes to efficiently and effectively manage this cooperative 
activity. The NASA and NOAA teams have strengthened their 
working relationship over the last three years. One example of the 
JPSS organization success is the upcoming launch of the Total 
Solar Irradiance Calibration Transfer Experiment, TCTE, later this 
year on a United States Air Force mission to be launched Novem- 
ber 4. 

The Suomi National Polar-orbiting Partnership, or SUOMI-NPP, 
was successfully launched almost two years ago and NOAA has 
operational control of this satellite. Meteorologists continue to use 
data products from instruments from SUOMI-NPP in their weath- 
er forecasts, and all of the data products have been publicly re- 
leased. 

In addition to this success of SUOMI-NPP, the transition from 
the NPOESS program to the new JPSS program is now finished. 
The JPSS program successfully completed two critical milestones in 
2013, keeping the program on schedule and within budget. Now, 
both the JPSS-1 satellite mission and overall program have moved 
from the planning and formulation phase to implementation and 
execution. 

NASA, as NOAA’s acquisition agent, manages all of the JPSS in- 
strument, spacecraft, and the majority of the ground system con- 
tracts. The first JPSS satellite, JPSS-1, will be a near clone of 
SUOMI-NPP with upgrades to meet the JPSS-1 level require- 
ments. The instrument vendors continue to make progress in the 
manufacture of the flight units for the JPSS-1 and the spacecraft 
is currently being fabricated. Additionally, the Delta II rocket has 
been selected as the launch vehicle for the JPSS-1 mission. 

The GOES-R Series program of four geosynchronous satellites 
continues to make progress toward launching GOES-R, the first 
satellite of the series, in the second quarter of Fiscal Year 2016. 
Last fall, the GOES-R Series program successfully completed a 
Mission Critical Design Review. Since then, the GOES-R and 
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GOES-S spacecraft have made good progress in component manu- 
facturing, and GOES-R is proceeding with spacecraft integration. 
Four of the six GOES-R instruments have completed environ- 
mental testing. 

The next major milestone for the GOES-R Series program is the 
Systems Integration Review, which is currently planned for the 
spring of 2014. Those performing the System Integration Review 
will evaluate the readiness of the program to start assembly, test, 
and launch operations. 

NASA and NOAA are committed to the JPSS and GOES-R pro- 
gram, and ensuring the success of these programs is essential to 
both the agencies and the Nation. The NASA and NOAA teams 
have established strong working relationships and are striving to 
ensure the weather and environmental requirements are met on 
the most efficient and predictable schedule without reducing sys- 
tem capabilities or further increasing risk. 

Once again, thank you for the opportunity to testify today. I ap- 
preciate the support of this Committee and the Congress for these 
critical programs and would be pleased to answer any questions 
that you may have. 

[The prepared statement of Mr. Watkins follows:] 



63 


HOLD FOR RELEASE 
UNTIL PRESENTED 
BY WITNESS 
September 19, 2013 


Statement of 
Marcus A. Watkins 

Director, Joint Agency Satellite Division 
National Aeronautics and Space Administration 
before the 

House Subcommittee on Investigations and Oversight 
and 

House Subcommittee on Energy and Environment 
Committee on Science, Space and Technology 
United States House of Representatives 

Mr. Chairmen and Members of the Subcommittees, thank you for the opportunity to appear 
today to provide you information regarding the NASA role in, and commitment to, the National 
Oceanic and Atmospheric Administration (NOAA) Joint Polar Satellite System (JPSS) and 
Geostationary Operational Environmental Satcllite-R Series (GOES-R) Programs. The JPSS and 
GOES-R Programs are critical to the Nation’s weather forecasting system, environmental 
monitoring and research activities. 

JPSS Organization is Working Well 

NASA and NOAA have been partners for more than 40 years in developing the Nation’s polar 
and geosynchronous weather satellites. With the President’s direction in 2010, NASA and 
NOAA included JPSS in this partnership. The NASA program office for JPSS has been 
established and is fully staffed with a complement of 1 14 NASA civil servants and 310 support 
contractors. NOAA and NASA have established joint agency-level program management 
councils to oversee JPSS, and have integrated their decision-making processes to efficiently and 
effectively manage this cooperative activity. The NASA and NOAA teams have strengthened 
their working relationship over the last three years. The following are a few of our latest 
successes. 

Suomi NPP Continues its Successful Operation 

The Suomi National Polar-orbiting Partnership, or “Suomi-NPP,” was developed to extend the 
record of key observations from the NASA Earth Observing System (EOS) series of satellites 
and to demonstrate space flight and ground data processing technologies for the next generation 
of operational polar-orbiting meteorological satellites. Suomi-NPP was successfully launched on 
October 28, 2011, activation and initial checkout are now complete, and NOAA has operational 
control of the satellite. 
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We are now reaching the end of a planned validation period, during which we are comparing the 
performance of the new sensors, both with data from on-orbit legacy instruments, and with high- 
quality ground-based and airborne calibration standards. As we characterize the performance of 
these new sensors, Suomi-NPP provides feedback to improve the operational instruments that 
will fly on JPSS. 

While the satellite was not originally intended to be used as an operational asset, NOAA will use 
Suomi-NPP data in its operational weather foreeasting models. NOAA meteorologists are 
already using data produets from three instruments - the Advanced Technology Microwave 
Sounder (ATMS), the Cross-track Infrared Sounder (CrIS), and the Visible Infrared Imager 
Radiometer Suite (VIIRS) - in their weather forecasts. All of the data products have been 
publicly released, and our analyses are indicating that the instruments on Suomi-NPP are 
performing excellently. 

JPSS Baseline is Established 

In addition to the successful Suomi NPP launch, the transition from the NPOESS program to the 
new JPSS program is now complete. The JPSS program successfully completed two critical 
milestones in July 2013, keeping the program on schedule and within budget. Both milestones 
were based on JPSS program eontent as outlined in the President’s FY 2014 Budget request for a 
streamlined program designed to meet NOAA’s weather mission. On July 17, 2013, NOAA 
approved the Key Decision Point -C for the JPSS-1 mission, establishing a baseline commitment 
confirming a second-quarter FY 2017 launch. On July 31, 2013, the Department of Commerce 
approved a combined Milestone 2/3 and Key Decision Point-I for the overall JPSS Program. 
These combined milestones established the full JPSS Program lifecycle cost of $1 1.3B, covering 
operations through FY 2025, the launch of JPSS-1 by second quarter FY 2017, and the launch of 
JPSS-2 by first quarter FY 2022. With these critical milestones now completed, both the JPSS-1 
satellite mission and overall program move from the planning and formulation phase, to 
implementation and execution. 

NASA, as NOAA’s acquisition agent, manages all of the JPSS instrument, spacecraft, and 
ground system contracts. The first JPSS satellite, JPSS-1, will be a near clone of Suomi-NPP 
with upgrades to meet the JPSS Level 1 requirements. The instrument vendors continue to make 
progress in the manufacture of the flight units for JPSS-1, and the spacecraft is currently in 
development at Ball Aerospace. Additionally, the Delta II rocket has been selected as the launch 
vehicle for the JPSS-1 mission. 

GOES-R Series Program Continues to Make Progress 

The GOES-R Series Program of four geosynchronous satellites continues to make progress 
toward launching GOES-R. Last fall, the GOES-R Series Program successfully completed a 
Mission Critical Design Review. Since then, the GOES-R and S spacecraft have made good 
progress in component manufacturing, and GOES-R is proceeding with spacecraft 
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integration. Four of the six GOES-R instruments have completed environmental testing. The 
GOES-R Extreme Ultraviolet and X-ray Irradiance Sensor instrument is in storage awaiting 
integration onto the spacecraft. The GOES-R Advanced Baseline Imager, Space Environment 
In-Situ Suite, and the Solar Ultraviolet Imager instruments have all completed environmental 
testing and will undergo pre-shipment reviews this fall in preparation for integration with the 
spacecraft next spring. The Geostationary Lightning Mapper instrument is completing its final 
assembly phase and will begin instrument-level environmental testing early this fall. 

The next major milestone for the GOES-R Series Program is the Systems Integration Review, 
which is currently planned for the spring of 2014. This review will evaluate the readiness of the 
program to start system assembly, test and launch operations. Given the magnitude of the work 
planned for FY2014, any reduction in the requested GOES-R Series budget will have significant 
impact on the program schedule and life cycle cost. 

Total Solar Irradiance 

One example of the JPSS organization’s success is the upcoming launch of Total Solar 
Irradiance Calibration Transfer Experiment (TCTE) later this year. The Total Solar Irradiance 
(TSI) climate record, which extends from 1978 to the present, is critical to understanding Earth’s 
climate variability. The SOlar Radiation and Climate Experiment (SORCE) is currently 
providing data continuity for the record, but there could be a gap between the end of SORCE and 
the launch of NOAA’s next TSI mission, the Total Solar Irradiance Sensor (TSIS). As such, the 
JPSS organization plans to launch the TSI Calibration Transfer Experiment (TCTE) late this year 
on a United States Air Force mission. 

Conclusion 

NASA and NOAA are committed to the JPSS and GOES-R programs, and ensuring the success 
of these programs is essential to both agencies and the Nation. The NASA and NOAA teams 
have established strong working relationships and are striving to ensure that weather and 
environmental requirements are met on the most efficient and predictable schedule without 
reducing system capabilities or further increasing risk. 

With the launch of Suomi NPP in October 201 1, the first fruits of the NASA-NOAA partnership 
for JPSS are being realized. With your continued support, NASA and NOAA expect this 
partnership to successfully develop and deliver the JPSS-1 mission on time for launch in FY 
2017, thus ensuring the continuation of the Nation’s capability to monitor the weather and 
environment. 

Mr. Chairmen, I appreciate the continued support of these Subcommittees and the Congress, and 
I would be pleased to respond to any questions you or the other Members of the Subcommittees 
may have. 
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Chairman Broun. Thank you, Mr. Watkins. 

I want to thank all of you for your testimony. 

Now, reminding Members that Committee rules limit questioning 
to five minutes, the Chair at this time will open the first round of 
questions by recognizing myself for five minutes. 

Ms. Kicza, there seems to be a big disconnect between what you 
say and your testimony and what we hear from other folks, and 
hopefully, we can sort all that out. One thing we have just heard 
from you is that lifecycle cost of JPSS is now at $11.3 billion, but 
the responsibility for three climate sensors were transferred to 
NASA. NOAA has entered a new budget line item for a polar-free 
flyer program that had previously been included in the JPSS pro- 
gram an estimate. Please explain how these actions are not just 
budgeting tricks to make it appear that costs have gone down, 
when in reality they have been transferred to somewhere else and 
taxpayers are still on the hook for them. 

Ms. Kicza. Yes, sir. In response to both Congressional feedback 
and the President’s Fiscal Year 2013 budget, as well as an inde- 
pendent review, NOAA in concert with the Administration took the 
actions to focus the JPSS program on the critical weather mission. 
In doing so, there were several activities that took place. One was 
transferring capabilities outside of the scope of the JPSS program. 
While the JPSS program was reduced, those costs still remain 
should be Administration and the Congress choose to continue to 
fund those. 

Chairman Broun. Well they are still there. Those costs are still 
there. 

Ms. Kicza. Yes. That is correct. 

Chairman Broun. You can transfer the cost so it is not actually 
a reduction in the cost to the program, is that correct? 

Ms. Kicza. It is a reduction in the cost of the JPSS program, not 
a reduction of the total cost of the program. In addition to that, as 
part of the JPSS activities, we also reduced costs there as well. 
And if you would like a question for the record, we can enumerate 
those particular costs. Some of them were due to reducing reserves 
given the positive progress that the program has made, as well as 
the positive results of the SUOMI-NPP mission. Other areas in- 
clude reducing areas of overlap between the NOAA and NASA ac- 
tivities particularly associated with the science. 

Chairman Broun. Well, let me ask you this, Ms. Kicza. GAO re- 
ports that identify the lifecycle costs, that is the sum of all recur- 
ring and one-time costs from cradle to grave of the program at 
$11.34 billion JPSS and $10.9 billion for GOES-R. Can you break 
those numbers down for us further? 

Ms. Kicza. Yes, sir. 

Chairman Broun. Let me ask, for example, how much is being 
spent on research and development for the ground components? 
How much is being spent on flight systems and sensors? How much 
will it cost to launch these satellites into orbit, and what are the 
estimated annual operating and maintenance costs? Can you give 
us those figures? 

Ms. Kicza. Sir, I would be happy to take a question for the 
record that enumerates all of those figures from both of those sat- 
ellite systems. 
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Chairman Broun. Okay. Well, I would appreciate it. We are 
going to give you some questions 

Ms. Kicza. Absolutely. 

Chairman Broun, to answer for the record, and if you would, 
please breakdown the cost associated with each program in re- 
sponse to the Committee’s questions for the record. 

Ms. Kicza. Yes, sir. Those are available. 

Chairman Broun. Okay. Mr. Powner, JPSS is reporting a 70 per- 
cent confidence in its planned launch date for JPSS-1. What con- 
cerns do you have that the JPSS-1 schedule will stay on track and 
what percentage would you give the program of meeting its March 
T7 launch date? 

Mr. Powner. So, Mr. Chairman, what we did is we looked in de- 
tail at various schedules with JPSS program. One of the key sen- 
sors, VIIRS spacecraft in the ground system, because those sched- 
uling practices give you confidence that ultimately you can hit a 
launch date. What we found were weaknesses in some of that 
scheduling. We actually found VIIRS to be stronger than the space- 
craft in the ground component, which was encouraging. When you 
look at the 70 percent confidence analysis that was done, it did not 
factor in all the components of the program, so our confidence 
would be less than 70 percent. 

Chairman Broun. Can you give us a number? 

Mr. Powner. I don’t have an exact number. It is definitely less 
than 70 percent. 

Chairman Broun. Is it less than 50? 

Mr. Powner. That would be difficult to say. You know, we would 
have to look at those numbers with the models that they ran with 
that assessment, and that was our one recommendation is to rerun 
that with a more realistic confidence level factoring in all of these 
issues, ground and all the things we found with the flight segment 
also. 

The key, Mr. Chairman, is this: I think these scheduling prac- 
tices, we are really focused on doing everything we can to tighten 
up those scheduling practices so that launch dates don’t slip any- 
more. We can’t have launch date slips because any further launch 
date slips like what happened on GOES, it appears insignificant, 
it is actually significant because it affects the backup situation. 

Chairman Broun. Right. 

Mr. Powner. That is really the focus that needs to occur. 

Chairman Broun. Absolutely. And particularly when you get 
into a backup situation, you are talking about 17-month gap in 
there and this is intolerable just for good weather forecasting. 

My time is expired. Now, I recognize Mr. Maffei for five minutes. 

Mr. Maffei. I thank the Chairman. 

Mr. Powner, just following on that, were you surprised by the 
delay in the launch in the first GOES satellite? And what issues 
are in play that may lead to further delays with GOES? 

Mr. Powner. The delay in the launch did not surprise us because 
last year we testified in front of this Committee that there was a 
48 percent confidence in the October 2015 launch date and we 
highlighted some scheduling weaknesses. In our report this year, 
we talk about some interim milestones that were missed, some 
technical issues, the Geostationary Lightning Mapper is one good 
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example, and then also further scheduling issues. So the delay did 
not surprise us. 

Mr. Maffei. It is difficult to overestimate the importance of 
weather prediction in my central New York State district. We get 
very bad weather, as people know. They are quite manageable be- 
cause we can predict the weather, we can get our plows on the 
roads, et cetera. It doesn’t slow us down in contrast to this city 
which can’t seem to handle — the thought of a flake of snow, every- 
body closes. 

Chairman Broun. One snowflake will close Atlanta. 

Mr. Maffei. Yeah — well, yeah. 

Chairman Broun. Almost. 

Mr. Maffei. Yeah, exactly. Yes. But we will get that — we will 
enter that into the record. 

But in any event, it is extremely important, and it is obviously 
extremely important to the Nation’s economy. And as we do see 
more and more storms and things like that — Hurricane Sandy was 
devastating and it was just the latest one — it is just absolutely 
vital that we get this going. 

So pardon me for leaving the technical stuff behind but, you 
know, John F. Kennedy announced we were going to the moon in 
1962 and seven years later we were there. We have got 3-1/2 years 
to wait just for the JPSS to launch, and that might slip. GOES has 
already slipped. I mean I — and so I go to — I talk to the staff and 
I say, well, it must be money, right? There is not enough money 
here? But my understanding is money is really not the issue. If it 
is, you can correct me, but — so I will start with Mr. Powner, can 
you educate me? What — why does it take so darn long to put these 
things up when we are 2013? We have been doing these satellites — 
are we making the perfect the enemy of the good? Is that the prob- 
lem? We want to have absolutely the latest technology on every- 
thing and so we, you know — I yield. 

Mr. Powner. Well, I think we did. I mean these things were 
much more complex in the past and they are being whittled down 
to becoming simpler and simpler with less sensors, and that is 
probably a good thing. 

But the reality is there were a lot of problems over the years, 
probably more significant than what we currently have. I mean I 
used to testify in front of this Committee where we would talk 
about one and two year slips and billion-dollar overruns like clock- 
work. It was like clockwork year-to-year. And that put us in the 
situation we are in. 

So I know the GOES. It slipped one quarter. Historically, if you 
look at that, that looks actually pretty good but it is not. It is not 
because it is significant. But the problem is is we have built up to 
this point in time where all these sins of the past with NPOESS 
and the whole bit, it is catching up to everyone and that is why 
we have a gap. That is why we added it to our high-risk list so it 
gets the right attention with the appropriate contingency plans. 

Mr. Maffei. Ms. Kicza and then Mr. Watkins, is there anything 
you can enlighten me with? Why does it take so long to get a 
weather satellite up in the greatest country in history in 2013? 

Ms. Kicza. I would offer that it is a combination of issues that 
cause it to be difficult to build these more rapidly than we cur- 
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rently are. First of all, these are complex systems for both GOES- 
R and for the JPSS system. With SUOMI-NPP, there were new in- 
struments, which oftentimes is more difficult when we start. 

However, I could contend that given the partnership that we 
have with NASA, our track record particularly on GOES-R has 
been very good. This is the first slip other than a protest we had 
with a contract early on that we have announced since 2007. And 
in fact the team itself continues to work to the earlier date. 

What we suggested is, given our reserve posture, we are commit- 
ting to a date that is in the second quarter of Fiscal Year 2016. The 
team itself continues to work to the earlier date. We have had sev- 
eral reviews of the schedule of confidence, including the one that 
Mr. Powner refers to. In going through the analysis of the GOES- 
R system, we all agree that the best thing to do is to continue to 
work to the earliest date possible, which is what this team is doing. 

Mr. Maffei. Thank you, Ms. Kicza. I want — it has improved that 
I do want to give Mr. Watkins a chance to explain. And are we 
making the perfect the enemy of the good? 

Mr. Watkins. I don’t believe that we are making perfect the 
enemy of the good. Again, when you are looking at these weather 
satellites and the instrumentation that we are carrying, the instru- 
ments are advanced. With respect to the JPSS, again, initially 
SUOMI-NPP was to be a research and development satellite, a sat- 
ellite that we would learn about the instruments. We now find our- 
selves in a position of utilizing that satellite operationally. Now, it 
is performing extremely well and the data products are already 
making their way into weather forecasting. 

The biggest challenge that we see is one of stability. What the 
programs, GOES as well as JPSS, need are stable funding so that 
we can plan accordingly, implement the programs. If you look at 
the track record associated with JPSS since the demise of 
NPOESS, we have been on schedule even with the challenges asso- 
ciated with in some cases delayed funding, in some cases — well, 
even with those challenges, we have been able to maintain the 
JPSS-1 launch date. 

Mr. Maffei. Mr. Watkins, thank you very much. Your point is 
good. I am already a minute over but I am sure we will continue 
to explore it. 

Mr. Watkins. Okay. Thank you. 

Chairman Broun. Thank you, Mr. Maffei. By the way, for the 
record, I was being very facetious. Atlanta does a great job of tak- 
ing care of snow when we get it down there. We don’t get as much 
as you all do in upstate New York, but I applaud what the Atlanta 
public works folks do in taking care of the snow. And 

Mr. Maffei. I am sure Representative Lewis will appreciate the 
correction. I will let him know. 

Chairman Broun. It just reflects, though, how important it is for 
not only upstate New York but for Atlanta and for California and 
for the whole country for us to get these satellites flying and get 
them on board. So thank you, sir. 

Now, Mr. Stewart, you are recognized for five minutes. 

Mr. Stewart. Well, thank you, Mr. Chairman. And I have a face- 
tious comment about Atlanta as well that I will forbear in order 
to be gracious. 
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I appreciate the testimony from the witnesses. I appreciate some 
of the questioning that has taken place. And it is interesting to me 
and honestly a little bit troubling to me some of the differences in 
opinions or perceptions based on some of the testimony and some 
of the answers to the questions. 

You don’t know so let me share with you. I was an Air Force 
pilot for 14 years. I flew one of the most sophisticated weapons sys- 
tems ever built. And I honestly — maybe because of that culture, I 
can’t imagine going into a mission without a backup. It just didn’t 
happen. And it would have been completely unacceptable if we pre- 
sented a proposal or a campaign where we didn’t have multiple 
backups. And yet that is exactly the situation we find ourselves in 
now. And I think we all agree that it is a mess. 

And now, I am convinced that this is a result of sequestration. 
Very clearly this goes back previous to the last year when seques- 
tration actually was implemented. But I don’t think it is entirely 
the fault of this Administration. I think this has been perhaps in 
the making for a little bit longer than that. 

But rather than look back, I would like to look forward to con- 
centrate on what we can do to mitigate some of these concerns that 
we have. And some of the options that we have that will maybe re- 
lieve some of the pressure, as I understand it, we are basically 
looking at generally two options. One of them is to rely on foreign 
sources of data, foreign government, particularly the Chinese, 
which is, I think, troubling for all of us. The second would be tap- 
ping into available commercial sources of some satellite or data ca- 
pability. I would appreciate any of you have input to that, would 
commercial data purchases help NOAA avoid having to rely on for- 
eign governments for much of this very critical data? Ms. Kicza, 
would you mind addressing that? 

Ms. Kicza. Yes, that is part of the contributions that we would 
take advantage of. In fact, if we are in a situation where we do 
have a gap, and I will say that our gap situation has improved 
since we last were before this Committee given the positive 
progress on SUOMI-NPP and the fact that we have remained on 
schedule for JPSS-1 and have accelerated JPSS-2. But in the event 
we do have a gap, NASA and NOAA are looking at several options 
and we are thankful for the funding in the Sandy Supplemental 
that is allowing us to move forward on that. 

That includes making better use of existing data, including 
microwave sensor data from the Defense Meteorological Satellite 
Program. Using our Cloud Impact Radiance data and using that 
more fully than we have been able to use it in the past, extending 
our current operational systems further into the future — NPOESS 
and the MetOp series — and making sure that we are sustaining 
that for as long as we are able to, and taking advantage of the new 
data sources that are planned for the future, including the poten- 
tial of commercial data sources. Radio occultation in particular is 
one of interest. 

Mr. Stewart. Okay. Let me pursue this a little bit if I could. I 
think most of us would be much more comfortable relying on U.S. 
sources, commercial sources than relying on foreign governments. 
Tell me the steps you are taking to prepare for that eventuality. 
Is the Administration moving forward to say, okay, when we reach 
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that point because many of us suspect that we will, this is what 
we are doing to prepare, and for example, are you working with 
any of these commercial providers right now to prepare so that we 
can move forward very quickly should we need to? 

Ms. Kicza. In response to the Sandy Supplemental funding that 
was provided in Fiscal Year 2013, NOAA is moving out on several 
fronts simultaneously to do the items that I just referred to. In ad- 
dition to that, we are improving our computational capability and 
doing operational simulations that will allow us to determine which 
is the best source of data to procure, whether that be through com- 
mercial or through international partnerships. 

Mr. Stewart. So, as I understand it right now, you are still just 
evaluating? 

Ms. Kicza. No, we are in fact moving out on those activities. 
Those are underway. 

Mr. Stewart. Okay. And a contracting process, is that under- 
way? 

Ms. Kicza. That is beginning in some of the activities. 

Mr. Stewart. Okay. 

Ms. Kicza. Yes, and if you would like a question for the record, 
I could — 

Mr. Stewart. Okay. 

Ms. Kicza. — enumerate that more for you. 

Mr. Stewart. Would either of the other witnesses have any per- 
spective you could add to that? 

Mr. Powner. I have a comment on the gap situation improving. 
I am not aware of the gap situation improving. NPP, if it lasts five 
years and maybe we are expecting it to last longer than five years, 
and hopefully it will so there is less of a gap, but that puts us in 
late 2016. We launch in March 2017. We have a year check-out. 
That gives us the 17-month gap we talk about. So our concern is 
we take the gap very serious so that we have the right plans in 
place and not downplay the likelihood of a gap. I think that is very 
important going forward so that we have the most robust plan in 
place. 

Mr. Stewart. Well, I appreciate that, Mr. Powner, I do, and I 
share exactly your sentiment. And I don’t think it is helpful for us 
to, you know, as I said in my opening statement, blue sky the sce- 
narios here. 

And, Ms. Kicza, I appreciate and I would encourage you and the 
Administration to continue to lean forward to looking at other op- 
tions, particularly the commercial options. That may be something 
that could be very beneficial to us and we are far better to be doing 
it now that we are to be doing in 2016. 

And with that, Mr. Chairman, I apologize for taking a little extra 
time and I yield back. 

Chairman Broun. Well, thank you, Mr. Stewart, and I think we 
all agree with that statement. We all on both sides are very eager 
to get these things flying and operational. It is absolutely critical 
for weather warnings for all of us, even upstate New York. 

Now, Ms. Bonamici, you are recognized for five minutes. 

Ms. Bonamici. Thank you very much, Mr. Chairman. I appre- 
ciate the discussion and want to follow up a bit and really get more 
focus on the expected gap. And I understand, Ms. Kicza, that the 
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current gap — and now we are talking about a range here — could be 
as low as we just heard, 17 months. I have heard it could be up 
to three years. So could you talk about what NOAA is — what steps 
NOAA is taking to make sure that the gap stays at the short end 
of that range? 

Ms. Kicza. First of all, refocusing the JPSS to a weather-focused 
mission improves our confidence in meeting both the JPSS-1 and 
JPSS-2 launch dates. As I said, JPSS-1 is on track; JPSS-2 has 
been accelerated. Close management of the Suomi operations will 
allow us to preserve that mission for as long as possible. And as 
I have mentioned, we now have two years of successful operations 
of Suomi on orbit. The issues that we would have expected to see 
that are referred to as “infant mortality issues,” early issues that 
will manifest themselves and present themselves as problems have 
not been seen on SUOMI-NPP. 

Both of these areas increase development schedule content — con- 
fidence. Keeping JPSS-1 on track and Suomi on orbit operation 
success gives us confidence that if SUOMI-NPP continues to per- 
form as expected, that we can significantly reduce our projected 
risk of a gap in orbit. 

Lastly, I will note that the projections that we had had in the 
past also assumed the time associated with calibrating and vali- 
dating the instruments on JPSS-1, our experience in SUOMI-NPP 
is also indicating that we may be able to reduce the time associated 
with the on-orbit check-out and calibration measurements on the 
JPSS-1. All of these contribute to reduced risk. 

Ms. Bonamici. Thank you. And I want to follow up on the 
SUOMI-NPP. Mr. Powner, in your testimony you say that the pro- 
gram estimates that there will be a gap of about a year-and-a-half 
from the time when the current SUOMI-NPP satellite reaches the 
end of its expected lifespan and when the JPSS-1 launch satellite 
will be in orbit and operational. So how do you calculate the ex- 
pected lifespan, and obviously, it is an expected lifespan so it will 
be shorter or longer, and what are you doing to plan for the entire 
span? 

Mr. Powner. So on NPP that was a demonstration satellite that 
was not built with the rigor that we will have on JPSS-1. 

Ms. Bonamici. Right. 

Mr. Powner. So the expected lifespan was three to five years. So 
the five-year mark, we use that as a — okay, that is — hopefully we 
get the full five years out of it and it could go longer, okay. We ac- 
knowledge that. But I think it is good to plan for five years. Five 
years puts you in late 2016. If you launch March 2017 and have 
a one-year check-out, which is typically how it goes — now, Mary, I 
am glad to hear that hopefully you can reduce that 12-month 
check-out. Those are the things that we want to see, but that is 
how we calculate the 17-month likely gap, and that is on the — that 
is best case scenario on our point because what happens is if NPP 
doesn’t last the full five years, it is longer. If JPSS-1 slips, it is 
longer. So all of those, that is how we get this range of likelihood 
of the gap. We think planning at least for a 17-gap is prudent. 

Ms. Bonamici. Thank you. And, Mr. Powner, I want to ask you 
another question, too. In your current report or past report — I 
know you have been working on this quite a long time — did you 
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ever identify the NASA Earth sciences budget allocation as a cause 
for delay in satellite procurement at NASA? 

Mr. Powner. We have not. 

Ms. Bonamici. And has trouble with climate sensors or a focus 
on the technology led to a delay in the satellite program or contrib- 
uted at all to the data gaps? 

Mr. Powner. Trouble with the climate sensors? Not particularly. 
The major issue was with the VIIRS. The major issue was with 
VIIRS if you go back historically and 

Ms. Bonamici. Thank you. And did — have you identified steps 
that might be taken to prevent a data gap from developing in the 
GOES program? I know in your testimony you do note that you 
made multiple recommendations to NOAA and NOAA has taken 
steps to address the recommendations. Have you identified steps or 
made recommendations to prevent the data gap — a data gap from 
developing in the GOES program? 

Mr. Powner. So on the GOES situation, it is a little different. 
It is a gap — it is not having an operational backup capability. That 
is very important because prior to Super Storm Sandy, we have 
repositioned the backup into operations. We did it again this year 
and 2012. So it is very important to have this operational backup. 

The issue there is with — when the current GOES launches, there 
is likely going to be about a year where we don’t have the oper- 
ational backup, so this little slip of a quarter, which could be as 
long as six months, pushes that to about a year-and-a-half. So 
there are fairly good contingency plans associated with the GOES 
program because they actually use them when they actually move 
satellites into operations. Really what you need to do is minimize 
any further slips in the launch of GOES so that we don’t have a 
further issue with the backup. 

Ms. Bonamici. Thank you very much. I see my time is expired. 

Thank you very much, Mr. Chairman. 

Chairman Broun. Thank you, Ms. Bonamici. 

Now, the Chairman recognizes Mr. Rohrabacher for five minutes. 

Mr. Rohrabacher. Thank you very much, Mr. Chairman. I ap- 
preciate the opportunity to get to know more about this program 
and appreciate that some people who are out there putting an 
awful lot of work into making sure that the American people have 
the information they need and a weather satellite system that will 
serve its very needs and protect us against the maladies of weather 
that have plagued humankind. A reading of history is a reading of 
people whose lives were destroyed by maladies in the weather. 

And today, we have come a long way in that. And I would like 
to ask Ms. Kicza how many total satellites do you have in orbit 
that you are looking after or looking after us? 

Ms. Kicza. In the polar orbit right now we have NOAA-15 and 
NOAA-16 are older satellites that are secondary. We had NOAA- 
18 as a secondary. 

Mr. Rohrabacher. Excuse me. So you have 15 satellites and 
then another 16? 

Ms. Kicza. No, I am sorry. In the polar orbit 

Mr. Rohrabacher. Yes. 

Ms. Kicza. — we have our primary operational satellite, which is 
NOAA-19. We have older satellites that remain in their orbits that 
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are still producing data although at degraded levels. So we have 
NOAA 15, NOAA-16, NOAA-18, NOAA-19, and SUOMI-NPP. In 
the geostationary orbit we have GOES 13, GOES 14, and GOES 15. 
So we have got one, two, three, four, five, six, seven, eight satellites 
that we are operating right now that are NOAA’s satellites. In ad- 
dition to that, we also support the Defense Meteorological Satellite 
Program and their series of satellites. 

Mr. Rohrabacher. So you have eight satellites and right now, 
we are in discussion about replacing how many of them? 

Ms. Kicza. The JPSS will replace the SUOMI-NPP. SUOMI- 
NPP is currently operating, as is NOAA-19. JPSS-lwill replace 
SUOMI-NPP in 2017. GOES-R will replace the on-orbit spare that 
by that time we likely will have positioned into a primary position. 
So it would replace GOES- 14. 

Let me take this opportunity to let the Committee know that all 
of our older satellites we continue to operate for as long as possible. 
The geostationary satellites, for example, GOES 13, 14, 15, they 
are designed for ten-year lives. We typically operate them until we 
have no fuel left. So the depletion of fuel for GOES-13, for example, 
is in the 2021 time frame. For GOES-14 and GOES-15, it is in the 
2024 time frame. 

Mr. Rohrabacher. So we are here to discuss replacing two 
today? 

Ms. Kicza. We are replacing — the plans are to replace the pri- 
mary spacecraft 

Mr. Rohrabacher. Right. 

Ms. Kicza. — when their primary missions are complete 

Mr. Rohrabacher. There are two? 

Ms. Kicza. — and most likely when they are degraded. 

Mr. Rohrabacher. Two satellites? 

Ms. Kicza. Yes. 

Mr. Rohrabacher. And you were just telling us now that there 
may be a need quickly when this fuel runs out to either replace or 
refuel these. 

Ms. Kicza. No, what I am suggesting is that we use our older 
satellites for as long as we can. 

Mr. Rohrabacher. Right. 

Ms. Kicza. They are not our primary satellites. They become sec- 
ondary. And that our current constellation that is in orbit, we will 
continue to fly those as long as we have fuel and the instruments 
are operating. 

Mr. Rohrabacher. Right. But you expect that fuel to run out 
within a number of five, six years? 

Ms. Kicza. For the geostationary satellites, if the instruments to 
perform and the satellite continues to perform 

Mr. Rohrabacher. Okay. 

Ms. Kicza. — the fuel will last long past when GOES-R would be 
launched. 

Mr. Rohrabacher. Okay. I have got to, I guess, get moving. 
Thank you for 

Ms. Kicza. Sure. 

Mr. Rohrabacher. — clarifying this for me. This is a very expen- 
sive program but a program that provides a very important and 
valuable service. 
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I would think that there have been other valuable services that 
government has provided in the past that has evolved into private 
sector services. And we want to especially, of course, encourage 
that at a time when the government has such a huge deficit that 
would help having the private sector put investment in where gov- 
ernment was the sole provider before. We had a nice discussion in 
my office the other day, and it just seems to me in listening today 
and reading about this, that there is a hesitancy about purchasing 
commercial data and thus evolving into a situation where the com- 
mercial companies could actually play a much greater role. 

At the same time, it is important to note that a commissioned 
study by NOAA suggested that maybe this gap, for example, could 
be handled — you call it the “silver bullet” solution — is to rely on 
data from Chinese government satellites. It seems to me that it is 
a pretty misplaced set of values here when we are more interested 
in Chinese satellite data and we are hesitant to use commercial 
data from our own American companies. 

And thank you very much, Mr. Chairman. 

Chairman Broun. Thank you, Mr. Rohrabacher. 

Now, Mr. Posey, your recognized for five minutes. 

Mr. Posey. Thank you, Mr. Chairman. 

Ms. Kicza, I understand that the GOES-R ground system con- 
tinues to make some very good progress toward the ground ratings, 
and I wondered if you could give me some examples of the 
progress, you know, how the installation of antennas in Wallops 
and Fairmont going? 

Ms. Kicza. Yes, sir. I am happy to do that. The GOES-R ground 
system has made excellent progress. The release of the mission 
management core ground element has been delivered to the NOAA 
Satellite Operations Facility in Suitland, Maryland. Four of the six 
new antenna structures have been completed. These are at the 
Wallops Flight Facility in Wallops Island, Virginia, and at our re- 
mote backup site and Fairmont, West Virginia. And the GOES-R 
ground system did complete its critical design review last July. 

Mr. Posey. Thank you. Also, what about the initial mission man- 
agement software? Has that been installed at NOAA Satellite Op- 
erations Facility and has it passed acceptance test yet? 

Ms. Kicza. Yes, sir, it has been installed at the NOAA Satellite 
Operations Facility and it is undergoing tests now. 

Mr. Posey. Okay. Mr. Watkins, I read recently that we missed 
on our orbit by two weeks gamma, ray bursts from the sun that 
would have knocked out quite a few of our satellites and perhaps 
taken down our grid. I am just wondering what your assessment 
of that is. If we had been on a two-week-later path, what damage 
do you think we would have sustained? 

Mr. Watkins. Sir, I am going to have to take that question for 
the record. I really don’t have the expertise in that area to speak 
on that. 

Mr. Posey. Do you realize there was any danger? I mean have 
you been advised? I mean you are the Joint Agency Satellite Divi- 
sion National Aeronautics Director. 

Mr. Watkins. That is correct, and my primary role is implemen- 
tation of NOAA’s portfolio of weather satellites. I am an engineer 
by training. I work to get them built. To talk about the science as- 
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sociated with a gamma ray burst, clearly they offer risk to our 
planet and there are steps that we take and monitor these. But I 
am — in no way would I care to really speak in depth on the impact 
of a gamma ray burst. 

Mr. Posey. Would you be kind enough to provide my office with 
that information? 

Mr. Watkins. Absolutely, sir. 

Mr. Posey. Okay. Thank you. 

Back to Ms. Kicza, given that the GOES-R will provide about 40 
times more data to the weather expert community, it is important 
that the users are going to be ready to actually utilize the informa- 
tion, hopefully. And I assume that stations are going to need to be 
upgraded. I am just curious about what you are doing to prepare 
the weather prediction community for this extraordinary increase 
in information that they are going to have available. 

Ms. Kicza. Yes, sir. In fact, the GOES-R program has for some 
time now implemented what we call GOES-R proving grounds. And 
in doing so, we work hand-in-hand with our operational weather 
forecasters to prepare them for what they are likely to see in the 
GOES-R era so that they know what to expect and how to utilize 
it. 

Similarly, to be ready to accommodate this data on the ground 
is an effort in and of itself. I mentioned the progress on the GOES- 
R ground system. We have about 150 racks of equipment coming 
in to the NOAA Satellite Operations Facility and the backup facil- 
ity in Fairmont, West Virginia, in just a few months. So there is 
a tremendous amount of work going on. And being ready to receive 
that equipment requires facility upgrades that are underway and 
on track. It requires that we have our ability to distribute that 
data in place. That, too, is on track. And in the long-term that we 
have the ability to archive that data, and we are working through 
our CLASS archive capability to prepare for that as well. 

Mr. Posey. Thank you. And I guess I have about a half-a-minute 
left. I just wondered if you could briefly comment on the instru- 
ments in GOES-R that I understand are weather-focused instru- 
ments that can observe weather not just here on Earth but we can 
also get a better view of the space weather. 

Ms. Kicza. That is correct. There are six instruments on the 
GOES-R series system. The Advanced Baseline Imager is the pri- 
mary weather imager, a critical instrument that has significant ca- 
pability over our current GOES assets in orbit. There is the Geo- 
stationary Lightning Mapper, which is a new capability that will 
allow us to see much more closely the cloud-to-cloud lightning, 
which is a major indicator of pre-thunderstorm activity. And in ad- 
dition to that, we have a suite of in-situ sensors that sense the 
space weather that are incoming to our planet. And all of those in- 
struments are progressing very well. 

Mr. Posey. Thank you. That is good stuff. 

I yield back, Mr. Chairman. Thank you. 

Chairman Broun. Thank you, Mr. Posey. 

And we will begin our second round of questions now. Hopefully, 
we will have at least five minutes for each Member. 

Ms. Kicza and Mr. Watkins, following up on questions from Mr. 
Stewart as well as Mr. Rohrabacher about this so-called “silver bul- 



78 


let” that Riverside Technology and Integrity Applications stated 
utilizing Chinese data, as they say, is the “silver bullet.” This im- 
plies that this provides an immediate and a definitive solution to 
a complex problem. Are you looking for this so-called Chinese “sil- 
ver bullet?” Mr. Stewart was asking about commercial utilization 
and so was Mr. Rohrabacher. Do you both agree with this charac- 
terization? Are you looking to the Chinese “silver bullet,” and what 
if any concerns that you would have about such collaboration? Ms. 
Kicza? 

Ms. Kicza. As you mentioned in your opening statement, security 
concerns exist with the use of Chinese data in the event of a gap. 
We are obviously very sensitive to that. NOAA believes that this 
would be a “whole-of-government” decision involving national secu- 
rity staff. 

Chairman Broun. Are you counting upon that, Ms. Kicza, as far 
as Chinese data? 

Ms. Kicza. No, sir. As we have indicated already, we have a host 
of activities underway beyond use of other international assets that 
we are actively exploring. 

Chairman Broun. Well, I certainly hope so. I hope that is not 
even a consideration. 

Mr. Watkins? 

Mr. Watkins. I have nothing to add. 

Chairman Broun. Mr. Powner, do you have anything to add to 
that? 

Mr. Powner. Well, we would agree that the security concerns, 
also of availability concern I think are big issue going that route, 
too. There are security concerns, but the availability issue when it 
is in fact available if you went that route needs to be strongly con- 
sidered. 

Chairman Broun. I certainly hope so. We have seen a lot of 
cyber attacks from China and it is a very strong concern of mine 
personally as a Member of not only this Committee but Homeland 
Security Committee about what is going on with China and they 
are attacking us. And utilizing them as a “silver bullet” is abso- 
lutely not appropriate, and I hope that you all will look to other 
sources and put in policy that is going to look to the commercial 
sources, as well as backfilling all these gaps and problems that we 
see. 

And, Mr. Powner, have NOAA or NASA satisfied GAO’s inquiries 
concerning the new structure, budgets, and timeline for the JPSS 
and the GOES-R programs? 

Mr. Powner. Yes, I think we are in alignment on what needs to 
be done — what the current budget is and the schedules and that 
type of thing. Our big push, Mr. Chairman, is that tightening up 
the management of those schedules, the integrated master sched- 
ule with JPSS and the components schedules. We are in the weeds 
with them on this, but it is important to be in the weeds so that 
they stay on that March 2017 launch date. 

Chairman Broun. Well, this is a weedy problem and it is some- 
thing that we need to fill because I am very concerned and I think 
all of us are concerned about these gaps. 

Mr. Watkins, does NASA have any concern about NOAA’s pro- 
posal to shift climate sensors to you? 
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Mr. Watkins. Again, sir, my area of expertise is in managing 
weather satellites, reimbursable programs on behalf of NOAA. 

Chairman Broun. Well, if you could answer that question for us 
in the questions for the record. 

Mr. Watkins. Yes. 

Chairman Broun. Can you answer this? Why would NOAA’s 
ownership of these instruments be better than under the current 
arrangement under NASA, which is building the instruments for 
NOAA? 

Mr. Watkins. Again, that is a question that I will have to take 
for the record. 

Chairman Broun. Okay. 

Mr. Watkins. We have a science division that handles those 
areas. 

Chairman Broun. And certainly if you would help us with that. 

Mr. Watkins. I will. 

Chairman Broun. Mr. Maffei, you are recognized for five min- 
utes. 

Mr. Maffei. I thank the Chairman, and I echo his remarks 
about depending too much on China. There is no bipartisan divide 
whatsoever on this. We are very concerned about it. Hopefully, they 
would — we would never have to rely on them. And on the Armed 
Services Committee, we, too, are very, very concerned about the 
cyber security issues and it would put us in a very awkward posi- 
tion to have to depend on that particular country for this stuff. 

I do want to get back to Mr. Rohrabacher’s comments on having 
the private sector more involved. Mr. Powner, my — I actually would 
be open to that. I am a big advocate of private sector involvement 
and public-private partnerships in the space program. But my un- 
derstanding is is that there are already private contractors that do 
most of the actual work that are hired to build the satellites and 
even launch the satellites into orbit. Is that true? 

Mr. Powner. Yeah, that is true. 

Mr. Maffei. Can you 

Mr. Powner. Private contractors, private companies, correct. 

Mr. Maffei. So there is not — so most of this is already private — 
well, public-private partnerships that really do it. 

Mr. Powner. Yeah, I think the key question is with the River- 
side analysis there was a suggestion that commercial providers 
could actually be used to help fill the gap. I think that is where 
the suggestion was. Both government for and commercial, all that 
was on the table with Riverside study. 

Mr. Maffei. Mr. Chairman, I might suggest that a study might 
be in order to have GAO take a closer look at whether there are 
any additional opportunities for public-private partnerships in the 
space program. I think it would be a bipartisan thing to 

Chairman Broun. Well, certainly. I think all of us would be very 
eager to make sure that that happens. 

Mr. Maffei. Okay. Thank you. 

Ms. Kicza, I think you are the right person to ask this to, but 
according to the GAO, key satellite data users were not fully in- 
formed about the changes to GOES-R capabilities or alternative ef- 
forts to receive the data needed in the event of a system failure. 
Have there been any outreach efforts in place to ensure that GOES 
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data will continue to enable users that are outside of NOAA to 
complete their mission and — I mean are there any outreach efforts 
just to make sure that all of the various scientific users and private 
sector users are kept informed of these sort of issues when they 
arise? 

Ms. Kicza. Yes, there are avenues, and I think that what Mr. 
Powner encouraged is that we strengthen those. And so we do have 
regular conferences that we present at, where the users are largely 
present where we highlight the changes that are made. We have 
operational working groups that reach out to the users that inform 
them and help us make decisions on any trades that we have to 
make. 

In addition to that, in a response to the recommendations of the 
GAO, we are working with the Office of the Federal Coordinator of 
Meteorology to reinstitute a committee that had been in place prior 
to NPOESS as an additional method of reaching out to other agen- 
cies and their users to ensure that they are kept abreast of how 
our programs are progressing. 

Mr. Maffei. Mr. Watkins, how has the sequester affected your 
agency’s ability to implement these weather-related programs? 

Mr. Watkins. So all of our funding is received via our partners, 
NOAA. And so clearly sequestration has had an impact on our abil- 
ity associated with stable funding, which is what we need in order 
to adequately be able to build operational weather satellites. 

Mr. Maffei. Ms. Kicza, same question to you. And do you have 
enough flexibility in order to at least keep everything on track? 
How is that affecting you? 

Ms. Kicza. As I mentioned in my oral testimony, we have worked 
hard in the face of sequester reductions received in FY2013 to try 
to maintain the launch schedules. We were able to do that with the 
JPSS, keep JPSS-1 on track. To be honest with you, the way that 
we did that is we impacted the Polar Free Flyer, the part that was 
outside of the JPSS. 

With the GOES-R, as I had also indicated, the team is working 
to maintain the earlier launch date. However, given the low budget 
reserve posture we have in light of the reductions, the commitment 
we are making is to the second quarter of Fiscal Year 2016 for that 
launch. 

Mr. Maffei. All right. Mr. Powner, I appreciate it if you would 
follow up on it just in terms of your analysis, the impact of the se- 
quester on these programs. 

Mr. Powner. So sequestration $54 billion, it was clear that 
GOES-R on our — based on our analysis a year ago and currently 
was going to slip without sequestration. So now they are saying 
part of the slip was due to sequestration. Sequestration, we don’t 
know the details on what actually affect that the slip. I will say 
this: There were two prime contractors, one with the spacecraft, 
one with the ground. They continued to do work. So we did not 
have a situation where work was stopped. 

Mr. Maffei. Okay. So work continued. 

Mr. Powner. I know there was arrangements cut with contrac- 
tors which was appropriate to keep the work going. So those details 
on how 54 equated to a one quarter slip, we don’t have that, but 
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I do want to say that I think it was likely going to slip without se- 
questration. 

Mr. Maffei. I thank the Chairman. I have gone three seconds 
over. 

Chairman Broun. Thank you, Mr. Maffei. 

Mr. Stewart, you are recognized for five minutes. 

Mr. Stewart. Thank you, Mr. Chairman. And again, I won’t take 
that long. I have just a very quick question. 

And this is helpful to me; I think it is helpful for the record. But 
I was going to ask you as witnesses to give your best perception 
or opinion on a scale of one to ten, ten being severe, one being we 
are in great shape, what is your perception of the potential the 
gapping and satellite coverage of being a problem to the United 
States? How big of a problem is it to you, Mr. Powner? Could you 
give me a perception on your feeling on that? 

Mr. Powner. I think for me it is a ten. 

Mr. Stewart. Okay. 

Mr. Powner. I think that we are predicting a 17-month gap. I 
think you are going to have a gap. 

Mr. Stewart. Yeah. 

Mr. Powner. Having no gap at all I think is highly unlikely, so 
I would put it at ten. 

Mr. Stewart. Okay. Thank you. 

Ms. Kicza? 

Ms. Kicza. The impact of a gap is severe. I would rate that as 
a 10. The probability of a gap I think is improving. 

Mr. Stewart. Okay. Would you give me a rating on that, what 
you think the probability is? 

Ms. Kicza. I would say given the progress we have made and the 
operations on SUOMI-NPP I would rate it as a five. 

Mr. Stewart. Five? And, Mr. Powner, your rating was both on 
the severity and also the likelihood, is that true? 

Mr. Powner. Correct. 

Mr. Stewart. Okay. Mr. Watkins? 

Mr. Watkins. I think for the JPSS program, given that SUOMI- 
NPP has been operating on orbit without any infant mortality 
issues, given the fact that I have confidence in the schedule associ- 
ated with JPSS-1, I would probably give it a four or five. 

Mr. Stewart. Okay. And that is on the likelihood? 

Mr. Watkins. Yes. 

Mr. Stewart. Not on the severity should we encounter a gap? 

Mr. Watkins. No. No. 

Mr. Stewart. Yeah. 

Mr. Watkins. And that is on the likelihood. The severity 

Mr. Stewart. Yeah. 

Mr. Watkins. — is huge. 

Mr. Stewart. Yeah. I hope that you who are more optimistic are 
right. I am afraid that you are not. I think it is in my opinion much 
more than a five. I think it is almost inevitable. 

Let me ask you one other question using the same kind of for- 
mat. What do you think are the best options? Do you think that 
the commercially available data is the best option? That should be 
the direction we are leaning? Or should we be leaning towards for- 
eign sources? Mr. Powner? 
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Mr. Powner. Well, I think it is clearly a combination not only 
of using additional satellites, whether it is some foreign, some com- 
mercial, some other government. I think you need to look at all 
those, but also, it is important to look at other weather observa- 
tions, observations from aircraft and also improving the weather 
modeling. 

Mr. Stewart. Okay. 

Mr. Powner. Weather modeling improvements could help, too. 

Mr. Stewart. Can help, too? 

Mr. Powner. It is a combination of everything. 

Mr. Stewart. So you would rate them all as equally important, 
one not being much more than another? 

Mr. Powner. Yes, I don’t know if I am in a position to say that 
it is better or not. I think that our recommendation is that we need 
to make the decisions on what the best options are given the cur- 
rent budget situation. 

Mr. Stewart. Which was part of my previous question. Let’s 
lean forward on that. 

Ms. Kicza, is one considered a strong preference in your opinion? 

Ms. Kicza. My strongest preference is to keep these programs 
funded, keep them stable so that these teams can execute. 

Mr. Stewart. Okay. 

Ms. Kicza. I think that is our strongest weapon against running 
a gap. 

Mr. Stewart. Okay. But if you had to choose right now, you 
know, as a relief as something that you could count on as backing 
up, would that be commercially available or foreign? 

Ms. Kicza. I would use a combination of the assets that are 
available to us. 

Mr. Stewart. Both of them being equal? 

Ms. Kicza. Yes. 

Mr. Stewart. Okay. 

Ms. Kicza. Yes. 

Mr. Stewart. Mr. Watkins? 

Mr. Watkins. Again, I believe that we need to remain as focused 
as possible on trying to meet our overall schedules and deadlines 
associated 

Mr. Stewart. Understanding 

Mr. Watkins. — and 

Mr. Stewart. — that, but if that weren’t to be the event, what 
would be your preference for the primary backup? 

Mr. Watkins. I think we would be looking at everything and I 
would defer to the expertise of NOAA to meet those needs. 

Mr. Stewart. All right. Thank you. And I yield back. 

Chairman Broun. Thank you, Mr. Stewart. 

Ms. Bonamici, you are recognized for five minutes. 

Ms. Bonamici. Thank you, Mr. Chairman. 

I don’t think I will take that long but I wanted to follow up on 
the question that Mr. Maffei asked about GOES-R. Ms. Kicza, the 
cost estimates on JPSS have gone up and down of course in recent 
years. At the high point, it was projected to be about $14.6 billion; 
now, it is down to $11.3 billion. Could you talk a little bit about 
how you have folded the key users and stakeholders in the process 
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to ensure that the essential functionality was not sacrificed in the 
search for savings? 

Ms. Kicza. Yes, ma’am. As we establish our requirements for the 
JPSS program, we worked very closely with all of the major line 
organizations within NOAA, the Weather Service being obviously 
the primary line organization, and assured that the requirements 
and trades that we are addressing are keeping their highest pri- 
ority requirements intact. Those are referred to as the Key Per- 
formance Parameters. So we worked very closely with our NOAA 
counterparts who are taking this data and providing the products 
and services that the broader country takes advantage of. 

In addition to that, as we go through these trades, there are mul- 
tiple opportunities to have dialogue with the broader community 
and we regularly engage in those forums. 

Ms. Bonamici. Thank you. And I want to follow up on what Mr. 
Stewart said earlier about looking forward. And obviously, there 
have been troubles in the past, and looking forward, I know that 
the Independent Review Team completed a report on the JPSS pro- 
gram last year. So what steps have you taken to follow the advice 
of the Independent Review Team? I think we all need some reas- 
surance that things are getting better. 

Ms. Kicza. The Independent Review Team, which was led by 
Tom Young and host of other very senior acquisition experts, pro- 
vided a report in July of last year, July of 2012. They had 23 rec- 
ommendations. This past August we brought that entire team back 
and we reviewed with them our response to all of those rec- 
ommendations. I think it is fair to say that they were pleased, 
quite pleased with the progress that has been made. They have 
identified a couple of areas that they want additional detail in, and 
we are scheduled to provide that information to them and they are 
projecting to have a report available in the November time frame. 

Ms. Bonamici. Thank you very much. 

And I yield back. Thank you, Mr. Chairman. 

Chairman Broun. Thank you, Ms. Bonamici. 

I thank the witnesses for your valuable testimony today, and I 
thank the Members for their questions. Members of the Committee 
may have additional questions for you, and I ask that you respond 
to those questions in writing, and please do it as expeditiously as 
possible. 

Let me remind you that everyone’s responses to our questions 
are expected in a very timely manner. I am not unreasonable and 
I can permit a delay of a week or two, but delays that extend for 
over one year are totally inexcusable and intolerable. 

The record will remain open for two weeks for additional com- 
ments and written questions from Members. 

Thank you all so much. The witnesses are excused and this hear- 
ing is adjourned. 

[Whereupon, at 11:34 a.m., the Subcommittees were adjourned.] 
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Answers to Post-Hearing Questions 
Responses by Mr. David Powner 

QUESTIONS FOR THE RECORD 

U.S, House Committee on Science, Space, and Technology Subcommittees on 
Oversight and Environment Joint Hearing 

“Dysfunction in Management of Weather and Climate Satellites” 
Thursday, September 19, 2013 
Mr. David Powner 

Director, Information Technology Management Issues, Government Accountability 

Office 

Questions submitted by Dr. Paul Broun. Chairman. Subcommittee on Oversight 


1) You testified that "NOAA does not yet have a comprehensive contingency plan" for 
gap mitigation. Can you specify the shortfalls and steps that are missing? 

In two of our recent reports, we identified shortfalls in plans to mitigate a potential gap in satellite 
coverage for both the JPSS and GOES-R programs. 1 On the JPSS program, while NOAA had 
documented alternatives it could use for gap mitigation, it had not yet selected the strategies to 
be implemented. In addition, NOAA's contingency plan did not always identify specific actions 
with defined roles and responsibilities, timelines, and triggers. Moreover, multiple steps 
remained in testing, validating, and implementing the contingency plan once the strategies have 
been selected and plans are updated to address the above shortfalls. On the GOES-R program, 
current contingency plans did not identify alternative solutions or time lines for preventing a 
GOES-R launch delay. For example, the plans did not take into account potential actions that 
NOAA could undertake to prevent a delayed launch, such as removing selected functionality or 
compressing test schedules. We recommended that, on both programs, NOAA establish 
comprehensive contingency plans that address these weaknesses. Until such plans are in 
place, its plans for mitigating potential gaps may not be effective in avoiding significant impacts 
to its weather mission. 

2) For JPSS, your report focuses on a potential gap in the 2015 to 2017 timeframe. Are 
there similar concerns about a gap between the first and second JPSS satellites in the 
early 2020s? 

While our recent report focused on the potential gap between October 2016, when the Suomi- 
National Polar-orbiting Partnership (S-NPP) satellite reaches the end of its expected lifespan, 
and March 2018, when the first JPSS satellite is expected to become operational, 2 there is also 
a potential for a gap between the first and second satellites. NOAA's decision to move up the 
launch date of the second JPSS satellite from December 2022 to December 2021 may help to 
reduce the likelihood of a gap in the early 2020s. However, if there are significant issues with 
the operations of the first JPSS satellite prior to the availability of the second satellite, then a 


1 GAO, Polar Weather Satellites: NOAA Identified Ways to Mitigate Data Gaps, but Contingency Plans and 
Schedules Require Further Attention, GAO-13-676 (Washington, D.C.: September 11, 2013); GAO, Geostationary 
Weather Satellites: Progress Made, but Weaknesses in Scheduling, Contingency Planning, and Communicating with 
Users Need to be Addressed, GAO-13-597 (Washington, D.C.: September 9, 2013) 


GAO-13-676. 
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gap could occur. In its October 2012 contingency plan, NOAA stated that future plan updates 
would address gaps between the first and second JPSS satellites. 

3) A JPSS and GOES-R highlights document distributed by NOAA says that 100 percent 
of JPSS performance milestones for FY12 were completed on time, and similarly 100 
percent of GOES-R FY13 critical milestones were met. What is your response to these 
statements, particularly in light of GAO's decision to list weather satellite programs in the 
agency's High Risk Series earlier this year? 

Our recent reports on the JPSS and GOES-R programs 3 identified several delayed milestones, 
which reinforce concerns about potential gaps in NOAA’s weather satellite programs raised in 
our 2013 High Risk Series. 4 Specifically, while NOAA had originally planned to complete efforts 
to validate products from the S-NPP satellite by October 2013, it currently expects to complete 
validating 35 products by the end of September 2014 and 1 other product by the end of 
September 2015, almost 1 and 2 years later than originally planned. Also, the delivery date for 
the CERES instrument experienced a 10-month slip due to a technical issue with the 
instrument's internal calibration monitor, and the ATMS instrument experienced an 8-month slip 
to its pre-environmental review due to an issue in one of the sensor’s channels. As another 
example, the JPSS program delayed completing the first satellite’s preliminary design review 
from February to June 2013 in order to address disconnects in the ground system schedule. 

Also, as we reported, over the past year the GOES-R program delayed several key milestones 
and tests, including reviews that would determine the program's ability to proceed to system 
integration and to complete mission operations, as well as several end-to-end system tests. 
Delays in one of these key reviews, the mission operations review, means that the large-scale 
integration of flight and ground components will not occur until 21 months prior to launch. 
Similarly, delaying end-to-end tests until 17 months prior to launch will allow the program less 
time to respond to any problems that occur. We have seen similar delays to key milestones in 
prior years. Given that fewer than 3 years remain before GOES-R’s expected launch, delays in 
key milestones and reviews decrease the likelihood that the launch date will be met. 

4) A June 2013 NOAA press release quoted the NOAA JPSS program director as saying, 
“Completing these reviews demonstrates the success and progress we are making 
within the overall JPSS program. ..I am proud of the work our combined NOAA/NASA 
team has done to aggressively implement this program and deliver our products on 
budget and on schedule ” [emphasis added]. Considering that JPSS is a continuation of 
the failed National Polar-orbiting Operational Environmental Satellite System (NPOESS) 
program, which was supposed to deliver six satellites carrying 11 unique sensors at a 
cost of $8.4 billion back in November 2009, do you consider the program to be “on 
budget and on schedule?” 

When viewed as the latest segment of an almost 20-year initiative to replace polar-orbiting 
environmental satellites, the JPSS program would not be on track compared to the original 
budget, schedule, and promised functionality. However, when focusing solely on this newest 


3 GAO-13-676 and GAO-13-597. 


GAO, High Risk Series: An Update, GAO-13-283 (Washington, D.C.: February 2013) 
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JPSS initiative, NOAA has made significant progress. As noted in our recent report on this 
program, while NOAA has missed selected milestones and modified its JPSS program’s cost 
and scope in recent years, as of September 2013 the program was on track to meet its $1 1 .3 
billion budget and March 2017 launch date schedule. 5 

5) NOAA has already indicated a slip in the GOES-R launch date of October 2015 by one 
fiscal quarter. What are some potential impacts of a delayed GOES-R launch - will it 
increase the lifecycle cost? 

A delay in the GOES-R schedule would likely affect the program’s lifecycle cost and increase 
the risk of a gap in satellite data. According to program officials, it is likely that the recent 3-6 
month launch delay will result in a lifecycle cost increase of at least $1 50 million. An increase of 
this amount would bring total lifecycle costs for the program to $11.01 billion. 

In addition, according to our recent report, delays in the launch of the first satellite in the R 
(GOES-R) series could lead to a gap in satellite coverage. 6 Beginning in April 2015, NOAA 
expects to have two operational satellites in orbit, but it will not have a backup satellite until 
GOES-R is launched and completes an estimated 6-month post-launch test period. Due to the 
program’s recent announcement that it would delay the launch of the first GOES satellite from 
October 2015 to the quarter ending March 2016, there could be a gap of up to 17 months during 
which time a backup satellite would not be available. If NOAA were to experience a problem 
with either of its operational satellites before GOES -R is in orbit and operational, it would need 
to rely on older satellites that are beyond their expected operational lives and may not be fully 
functional. 

6) Technical issues with the lightning mapper instrument on GOES-R may further delay 
or interrupt progress on GOES-R. In your view, does NOAA have an adequate system in 
place, including the ability to consult with users to make a decision about its inclusion 
on GOES-R? 

In September 2013, we reported that the GOES-R program may not include the Geostationary 
Lightning Mapper (GLM) instrument on the first satellite, and that NOAA’s system of informing 
users about planned changes such as this was not adequate. 7 

The GOES-R program is considering not including a GLM instrument in the first satellite due to 
issues raised during testing and the resulting changes to its development and testing schedule. 
The removal of this instrument would cause a significant reduction in the satellite’s functionality, 
which has the potential to impact satellite data user operations. Key GOES users have stated 
that they would prefer that NOAA delay launching the GOES-R satellite rather than launch it 
without the GLM instrument, and raised concerns that potential changes to the instrument could 
affect their operations. 

However, we reported that the GOES-R has not effectively involved satellite data users in 
changes to the program’s anticipated functionality. We recommended that the program improve 


5 GAO-13-676 

6 GAO- 13-597 


GAO- 13-597 
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communications with internal and external satellite data users on changes in GOES-R 
requirements by, among other things, seeking information from users on any concerns they 
might have about past or potential changes. NOAA agreed with this recommendation and has 
since instituted a taskforce to establish a governmentwide governance and coordination 
mechanism for satellite operations. We will continue to monitor NOAA’s progress in addressing 
our recommendation. 
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Responses by Ms. Mary Kicza 

HOUSE COMMITTEE ON SCIENCE, SPACE, AND TECHNOLOGY 
SUBCOMMITTEE ON OVERSIGHT 
AND 

SUBCOMMITTEE ON ENVIRONMENT 

“Dysfunction in Management of Weather and Climate Satellites” 

QUESTIONS FOR THE RECORD 

Ms. Mary Kicza. Assistant Administrator. 

Satellite and Information Services. NOAA 

Questions submitted by Chairman Paul Broun 

1) What are NOAA’s priorities between funding research to improve short-term weather 
forecasts and warning versus long-term climate change research? 

Response: Part of NOAA’s science, service, and stewardship mission is to understand and 
predict changes in climate, weather, oceans, and coasts. All components of NOAA’s research 
portfolio are critical and none is favored over another. NOAA’s Office of Oceanic and 
Atmospheric Research (OAR) conducts research in all of these areas, and funding levels for each 
element of the portfolio vary from year to year depending on need. 

It is important to understand that we cannot advance science in one of these areas without 
increasing our understanding in others. To improve weather forecasting, we must also improve 
ocean and climate science. The ocean and atmosphere are inextricably linked, and the patterns of 
one affect the other. This requires robust observations and models that integrate the ocean and 
the atmosphere at all time scales, short to long-term. Weather conditions over the United States 
(US) are strongly affected by seasonal climate variations occurring in the tropical oceans, 
atmosphere, and the polar vortex. They also are influenced by changes in surface characteristics 
(for example, sea surface temperatures, soil moisture, and snow cover) and storm track shifts 
associated with global-scale circulation changes. 

One key example of an aspect of climate research that increases our understanding of weather is 
the El Nino/Southem Oscillation (ENSO). ENSO is a recurring pattern of periodic wanning in 
ocean temperature off the coast of South America. La Nina is the complementary period of 
cooling water. This significant change in water temperature across a large ocean affects weather 
patterns worldwide. In the US, our short-term weather can be affected by these slightly longer- 
term, seasonal events that we consider "climate." Since El Nino peaks in strength during the 
Northern Hemisphere’s fall, winter, and early spring, its effects on weather also peak then, 
driving the heaviest snow locations in the US and all of North America. This driver often results 
in higher than average snowfall to the southern portion of the US, and less snow with warmer 
temperatures across the northern third of the US. Similarly, other inter-annual, and even decadal, 
variations present in the coupled atmosphere-ocean system can result in more or less drought in a 
given season. Each of these elements is linked, and it is critical that we invest in balanced efforts 
to ensure that our models include all spatial and temporal scales of observations for our coupled 
atmosphere-ocean models to yield the best predictive capability. 
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2) When does NOAA plan to make final, viable decisions on the set of contingency 

strategies it will implement to deal with the possibility of a gap in the afternoon polar 
orbit? Further, w ithout timely decisions by the agency, what are some of the “windows 
of opportunity” that NOAA would lose out on as possible mitigation options? 

Response: NOAA’s approach to gap mitigation activities is that it is a continuous process, 
rather than a “final set” of contingency strategies. NOAA, in conjunction with NASA, is always 
seeking new and innovative strategies to address this complex issue. The current gap mitigation 
plan is two pronged: 

1) Preventing or minimizing the potential for a gap 

2) Reducing the impact of a gap, should one occur 

NOAA submitted a comprehensive mitigation plan to the Government Accountability Office, 
which describes in detail the actions NOAA is taking on both of these fronts to address the 
potential for a gap in the afternoon polar orbit. It is important to note that this is not intended to 
be a “final” report, but rather a dynamic plan which NOAA will update regularly. 

Using Sandy Supplemental funds, NOAA prioritized the gap mitigation efforts which offer the 
highest impact on reducing the adverse effects of a gap on the weather forecasting enterprise and 
its mission to protect life and property. NOAA commissioned a rigorous, independent analysis to 
identify those options that had the highest potential to preserve National Weather Service (NWS) 
product quality in the face of a potential loss of NOAA polar satellite data. As stated above, 
NOAA and NASA are working on analyzing the recommendations and determining the best 
course forward. 


3) The JPSS program has gone through several cost estimating exercises in recent years. 
We’ve seen the estimate increase from $11.9 billion to $14.6 billion and then decrease to 
its most recent level of $11.3 billion with numerous revisions to promised scope and 
capabilities, including altering the number of years the program will last. During the 
hearing, I asked you to enumerate the reductions in cost and other actions taken in the 
JPSS program to reach the $11.3 billion life-cycle estimate. You could not provide the 
exact figures at the time but offered to provide the amounts in response to a question 
for the record. Please answer the below: 

a. How much will be spent on research and development for the ground 
components? 

b. How much will be spent on flight systems and sensors? 

c. How much will it cost to launch these satellites into orbit? 

d. What are the estimated annual operating and maintenance costs? 


Response: The $1 1.3 billion JPSS program baseline life cycle cost includes $2.5 billion 
NPOESS sunk costs from FY 1995 - FY 2010, and $2.6 billion JPSS sunk costs from FY 201 1- 
FY 2013. The responses below represent the $6.2 billion that will be spent from FY 2014 
through FY 2025 and are not based on the total life cycle cost. The estimated amounts below are 
based on the JPSS Program as outlined in the President’s FY 2014 Budget request and beyond. 
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a. The JPSS Program will spend approximately $1 .5 billion for research and development 
for ground systems. 

b. The JPSS Program will spend approximately $2.54 billion on flight systems and sensors. 

c. The JPSS Program will spend approximately $0.5 billion to launch the JPSS-1 and JPSS- 
2 satellites into orbit. 

d. The JPSS Program will spend approximately $1.9 billion for annual operations and 
maintenance costs between FY 2014 through FY 2025 (approximately $0.2 billion each 
year). This amount includes sustainment in addition to operations and maintenance costs 
to provide a complete accounting. Sustainment is necessary to periodically replace 
obsolete components (software and hardware). Science costs (such as algorithm 
development, calibration and validation, data archive and access) are included in research 
and development for ground systems, above. 

4) Please answer question 3 with regard to the GOES-R program. 

Response: As of the FY 2014 President’s Budget, the GOES-R Series program is baselined as a 
four-satellite program at $10,860 billion through FY 2036. The estimated amounts below are 
based on the GOES-R Program as outlined in the President’s FY 2014 Budget request and 
beyond. 

a. The development contracts, program/project support, and technical management for 
ground components have an expected cost remaining of $0.8 billion after FY 2013. 

b. The development contracts, program/project support, and technical management for the 
flight systems and sensors (excluding launch services) have an expected cost remaining 
of $2.3 billion after FY 2013. 

c. The expected cost remaining for four satellite launches is $1.3 billion after FY 2013. 

d. The estimated operations and maintenance costs are approximately $70 million per year. 
The total operations and maintenance for GOES-R in the FY 2014 President’s Budget is 
$1.2 billion through FY 2036 -all of this remains after 2013. 

After FY 2013, GOES-R Series Program will have an additional $1.2 billion in Program Costs 
which will fund science, civil service and supporting costs, support contractors, and contingency. 

5) How often do transfers of reserves occur between the four GOES series satellites? 

Please identify all instances of transfers, including the amount and reason for the 

transfer. 

Response: No transfers of reserves have taken place between the four satellites in the GOES-R 
Series Program. The reserves are tracked by contract (e.g. spacecraft, individual instrument 
contracts, ground station and antennas). Additional reserves are held at a level above individual 
contracts. Each spacecraft and instrument contract is procuring four Flight Models (FM) to 
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support GOES-R, S, T, & U. The GOES-R Series Program also tracks reserves as a percentage 
of work-to-go. This ensures adequate reserves remain for future work on satellites GOES-S, -T, 
and -U. 


6) Fifty-four million dollars is between 6% and 7% of the FY 2013 budget allocation of 
$802 million. Please provide a breakdown of which specific program 
components/systems were delayed as a result of the $54 million reduction in funding in 
FY 2013. 

Response: In response to the $54 million reduction in the enacted FY 2013 appropriations bill, 
the GOES-R Series Program took the following actions: 

• Deferred work that had been planned in FY 2013 for the GOES-R Spacecraft and 
Advanced Baseline Imager (ABI) to FY 2014, which reduces schedule flexibility and 
contingency in FY 2014. 

• Rephased the launch vehicle payment schedule, which resulted in a direct impact to 
GOES-R and GOES-S launch vehicle assembly activities. 

• Deferred work planned in FY 2013 on GOES-S hardware and GOES-R and GOES-S 
Solar Wing Assembly work. 

• Extended Ground Integration and Test. 

Full funding of the FY 2014 President’s Budget request of $954,761 million is required to avoid 
any further deferments of work needed to meet GOES-R Series Program development and 
launch schedules. 

7) According to the GAO report on Polar Weather Satellites, NOAA has established a new 
Polar Free Flyer program for which a transition plan is currently under review, select 
staff positions have been filled, and the JPSS program plans to award a contract in FY 
2014 for a spacecraft to accommodate three instruments. 

a. How much will the Polar Free Flyer cost? 

Response: The President’s FY 2014 Budget requested $62 million to start the procurement for a 
spacecraft that will host the Total Solar Irradiance Sensor-1 (TSIS-1), Advanced Data Collection 
System (A-DCS), and Search and Rescue Satellite Aided Tracking (SARSAT). 

The total life cycle cost is $335 million for the Polar Free Flyer as identified in the FY 2014 
President’s Budget request. 

b. When will you be able to provide the committee additional specific and substantive 
information about this Free Flyer program, including costs, schedule, performance 
and program management objectives? 

Response: The President’s FY 2014 Budget had requested a new program entitled Polar Free 
Flyer program, which consisted of procuring a Free Flyer-1 spacecraft, ride share launch 
services, operations and sustainment, and accommodation costs for the TSIS-1, the ADCS-1, and 
SARSAT-1 instruments. The Polar Free Flyer mission would have provided for the 
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accommodation of an Advanced Data Collection System-2 (ADCS-2) instrument on a to-be- 
determined spacecraft. 

The Polar Free Flyer program addressed NOAA’s requirements to provide global environmental 
data, such as variability in the Sun’s total output, as well as search and rescue, direct read-out 
data transmission, and data collection services. 

NOAA will continue its partnership with NASA on a cost reimbursable basis to implement the 
Polar Free Flyer program, using NASA’s space acquisition expertise and acquisition authority to 
procure the spacecraft, to test and integrate the instruments, and to acquire and execute launch 
services. 

A life cycle cost of $335 million was planned through year 2025. The FY 2014 base for the Polar 
Free Flyer program was created through a technical transfer of funds from the JPSS program, 
which has been refocused to a core weather-based mission. The life cycle cost of JPSS has been 
reduced, and no longer includes the costs that were planned for the activities now covered in the 
Polar Free Flyer program. 

The planned launch of the Polar Free Flyer had been July 2016, based on October 1, 2013, 
receipt of FY 2014 funds. A revised launch date will be developed once final FY 2014 
appropriations are received. 

The current status of the Polar Free Flyer program: 

TSIS has gone through pre-ship review in early December 2013 in Boulder, Colorado. 

Our European and Canadian partners are building the ADCS-1 and SARSAT payloads which are 
on track for delivery in time for integration and launch. However, as noted above, due to the 
delay in the FY 2014 appropriation, NOAA will have to provide a revised plan for the spacecraft 
and launch services. 

8) Congress provided NOAA with funding through the Sandy Supplemental 
Appropriations Bill, which can be used for an Observation System Simulation 
Experiment (OSSE) study on how geostationary hyper-spectral data can assist weather 
forecasts, most especially with regard to severe storms and two to five-day forecasts. It 
is our understanding that NOAA has begun this OSSE. When will NOAA deliver the 
final results of the study to Congress? 

Response: NOAA is conducting an OSSE, which is expected to indicate whether geostationary 
hyperspectral data are likely to make a significant improvement in forecasts of storms. NOAA 
funded and began conducting this OSSE before Supplemental funds were finalized so that the 
results will be available in time for an examination of possible mitigation solutions of any 
potential JPSS data gap. Results from this assessment, focused on forecasting hurricanes, are 
anticipated to be complete by Fall of 2014. A more detailed OSSE, using upgraded tools and 
analysis supported by the Supplemental funding, that will estimate the magnitude of the 
contribution of geostationary hyperspectral data to storm predictions is anticipated to be 
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complete by November 2015. NOAA will be happy to share the results as components of the 
work are completed. 

9) In your written testimony you say that NOAA is strategically using Sandy 
Supplemental funds to make its weather forecasting enterprise more robust in the face 
of the possibility of a gap in polar-orbiting weather data. 

a. Why aren’t any of the Sandy Supplemental funds being applied to the GOES-R 
program to prevent additional delays? 

Response: Both the JPSS and GOES-R programs are critical national assets to providing 
weather data for severe storms. NOAA is working to address any risks for gaps in the data that 
these systems provide. To ensure the maximum benefit was derived from the supplemental 
funding that the Congress provided, NOAA has prioritized the gap mitigation efforts which offer 
the highest impact on reducing the adverse effects of a gap on the weather forecasting enterprise 
and its mission to protect life and property. NOAA commissioned a rigorous, independent 
analysis to identify those options that had the highest potential to preserve NWS product quality 
in the face of a potential loss of NOAA polar satellite data. This was the basis of the spend plan 
for the Sandy Supplemental funds that Congress approved in June 2013. 

10) Enhancements in the upcoming instruments and satellites for JPSS and GOES-R make 
the National Weather Service’s (NWS) Ground Readiness Project (GRP) critical to 
NOAA’s ability to benefit from the anticipated amplified data stream. 

a. What is the status of the GRP? Will it be ready to accommodate the data from both 
JPSS and GOES-R once the next satellites in those series arc launched? If not, what 
impact will that have on NOAA’s ability - or inability - to take advantage of the 
enhanced and improved data stream? 

b. How much Sandy Supplemental funding is being used to support the GRP, and at 
what point did NWS become aware that it would need supplemental funding to 
support the GRP? 

Response: 

a. GRP is on track to accommodate the data from both JPSS and GOES-R, as outlined in the 
President’s FY 2014 Budget request. 

b. NWS is using $13 million as provided in the Sandy Supplemental funding for the GRP. 
Congress recognized GRP funding was critical to ensure the new satellite data would be 
able to be used by NWS and funded the FY 2013 request via the Sandy Supplemental 
funding. Subsequent to the Sandy Supplemental, Congress approved the President’s 
original FY 2013 request for GRP funding in the regular full-year appropriation for 
NOAA. Because the additional funding was not required, the full-year appropriated funds 
were reprogrammed as part of the NOAA spend plan approved by Congress. Additional 
GRP funding for FY 2014 was always planned, and is requested as part of the FY 2014 
President's Budget request. The GRP request for FY 2014 is $15.4 million. 

11) What are NOAA’s obligations toward the FAA’s Next Generation Air Transportation 
System (NextGen) program? Given the delays in NOAA’s satellite programs, will 
NOAA be able to meet these obligations according to the FAA’s schedule? If so, how 
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will NOAA compensate for the data gaps from the delays and termination of 
instruments in the satellite program? 

Response: 

a. NOAA’s obligations towards NextGen are to improve NOAA’s dissemination of and 
access to aviation-related weather information for the National Airspace System on an 
ongoing near-real-time basis and to improve the accuracy of that information. 

b. The original short-term NextGen deliverables will be met. The delays in NOAA’s 
satellite programs will not hinder this short-term obligation to the FAA, because it is not 
tied to future satellite operations. In late 2015, NOAA will deliver capabilities for 
improved dissemination of aviation weather information to the FAA for NextGen. The 
FAA is currently revising and deriving weather requirements from its Mid-term NextGen 
Concept of Operations document, which is being used to transition from the current 
National Airspace System to the NextGen System as envisioned in the original Joint 
Planning and Development Office Concept of Operations. Once those requirements are 
complete, NOAA will work with the FAA on how best to fulfill them in the timeframe 
those capabilities and improvements are needed. 

c. The potential gap in satellite data affects all NWS programs, not just NextGen support. 
NWS received $51.5 million in satellite gap mitigation funds from the Sandy 
Supplemental, which are being applied across many programs to help mitigate the impact 
from the potential loss of satellite data. These activities include additional aircraft 
observations, an increase in computing capacity, improved data assimilation, and 
transitioning model development/improvements into operations. While not a replacement 
for the potential loss of satellite data, these activities will lessen the impact. 

12) GAO’s report on GOES-R reads, “According to a NOAA program official, the GOES- 
R program is able to meet NASA’s requirement [of contingency reserves] through the 
combination of the 20% flight and ground project requirements and the supplemental 
10% program-level reserve.” Given this information, how much money is there in the 
GOES-R series reserve fund for both flight and ground projects? Why have these 
funds not been used to fill the $54 million funding gap responsible for the latest launch 
delay? 

Response: Contingency is used during the year to deal with technical issues and risk items that 
arise during that year. The $54 million cut in the enacted FY 201 3 appropriations bill eliminated 
all FY 2013 contingency and required moving work into FY 2014. This, in turn, creates a low 
contingency situation for FY 2014 which is during the critical integration and test phase of the 
program where these issues are typically faced. While the program has sufficient overall 
contingency (i.e., over 25%) as a percentage of work to go, most of these reserves result from 
requested future year appropriations. Therefore, the current risk associated with not having 
sufficient currently-available contingency funds results in lower probability of meeting the first 
quarter GOES-R satellite FY 2016 launch commitment. 

Note that the NASA requirement of contingency reserves is based on NASA’s historical record 
of on-hand funding needed to address technical issues that may arise. The requirement for 
contingencies is not established to cover budget reductions. 
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13) Congress received testimony in a November 16, 2011, hearing before the Senate 
Subcommittee on Oceans, Atmosphere, Fisheries, and Coast Guard, from Robert 
Marshall, Founder and CEO of Earth Networks, Inc., suggesting that new technologies 
developed by the private sector have obviated the need for some of the multi-million 
dollar instrumentation planned for GOES-R. For example, private sector companies 
have developed and are already operating ground-based lightning detection systems 
that at significantly less cost, deliver many, and perhaps more, of the benefits of the 
$100 million GOES-R satellite lightning sensor, including higher resolution and 
accuracy. 

a. To what extent has NOAA considered replacing the GOES-R lightning sensor so 
that it can make use of the more cost effective ground-based lightning detection 
systems? 

Response a: The ground-based networks and geostationary satellite lightning detection and 
mapping are complementary. NWS is investigating the advantages of satellite lightning 
detection, as described below, and does not have sufficient information at this time that would 
warrant replacing the GOES-R lightning sensor. It is not clear that either a ground-based or 
satellite based system alone could meet NWS requirements. 1 

Lightning flashes that strike the earth are called cloud-to-ground flashes. Total lightning includes 
cloud-to-ground flashes as well as intra and inter cloud (‘'in-cloud”) flashes. The majority of 
total thunderstorm lightning are in-cloud contained flashes that never strike earth. The user 
requirements for total lightning are to locate the lightning with sufficient accuracy and consistent 
performance to monitor individual storms and to deliver this information to forecasters with 
minimal latency. Total lightning adds critical information on the early onset and rapidly evolving 
changes in storm intensity. In-cloud discharges occur minutes prior to the first cloud-to-ground 
flash, providing the earliest indication of potentially dangerous thunderstorms. 

As much as 20 minutes before a storm becomes severe (winds, hail, or tornadoes) it displays a 
significant increase in total lightning data. This often occurs many minutes before the radar 
detects the potential for severe weather. Thus, used in tandem with radar, visible satellite, and 
surface observations, total lightning data has potential to increase lead time for severe storm 
warnings. Overall, knowledge of total lightning activity and its extent are paramount for public 
safety. 

The ground-based networks exhibit spatial as well as temporal (even day-to-day) variability in 
total lightning detection, with coverage over the ocean basins being the poorest. The absence of 
total lightning detectors over oceans (at the required density for total lightning detection) and the 
expense of having sites throughout remote areas limits any ground-based network to total 
lightning detection efficiency ranging from a high near 30 percent to near 0 percent on a month- 
by-month basis. This is in large part why the ground-based systems are much less effective than 
a space-based optical detector in monitoring total lightning and in particular the in-cloud activity 
over large data sparse regions. The Geostationary Lightning Mapper (GLM) on the GOES-R 


1 The Federal Lightning Capability Requirements (FCM-R27-2008) includes all Federal Agency lightning 
requirements (http://www.ofcm.gov/r27-lds/fcm-r27.htm). 
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Series is expected to detect total lightning over land and oceanic regions with nearly the same 
uniformly high (~85 percent estimate) flash detection day and night and provide detailed 
information on which storm produced the flash, where the flash began, its propagation, 
horizontal extent, duration, and intensity (radiance), all of which are related to the energetics of 
the discharge, the characteristics of the storm, and the risk to life and property. Ground-based 
networks, on the other hand, only provide a single point in space and time for each ground strike 
or cloud flash, but not the totality of the in cloud flash origin, propagation and horizontal extent. 
For a ground strike at an airport or soccer field there is no way for a ground-based network to 
know which storm is actively producing these discharges which may be tens of miles away. 
Understanding the origin of cloud flashes, as GLM will be able to do, is necessary if one is 
monitoring the sudden increase of in-cloud lightning as a precursor for a specific storm that may 
become severe. If you don’t know which of several storms produced the flashes, you will not 
correctly diagnose the evolution of one storm from another. 

Given the expected benefits that GLM will provide, NOAA is continuing to pursue the GOES-R 
lightning sensor. 


b. What steps is NOAA taking to prioritize its lightning (and other) observing needs by 
taking advantage of emerging cost-effective technological developments available 
from the private sector? 

Response b: NOAA has already taken advantage of technological developments from the 
private sector through the use of ground-based lightning detection networks. These networks 
provide an important observational capability which is helping to meet NWS operations. 
However, the ground-based networks exhibit spatial as well as temporal (even day-to-day) 
variability in total lightning detection, with coverage over the ocean basins being the poorest. 

The absence of total lightning detectors over the oceans and the expense of having sites 
throughout remote areas of the world limit any ground-based network from having high total 
lightning detection efficiency. This is in large part why the ground-based systems are much less 
effective than a space-based optical detector in monitoring total lightning and in particular the in- 
cloud activity over large data sparse regions. 


Questions submitted by Chairman Chris Stewart 

14) The Committee understands that GPS Radio Occultation (GPS RO) data (which uses 
the bending of radio waves in the earth’s atmosphere to accurately measure 
temperature, pressure and water density) offers the potential to significantly improve 
the quality of our nation’s terrestrial and ionosphere weather forecasts. Among other 
benefits, GPS RO data can significantly increase the accuracy of hurricane 
predictions. How valuable to NOAA do you consider GPS RO measurements? 

Response: 

GPS Radio Occultation (RO) has shown to augment weather forecast skill at NOAA. This is 

primarily due to the high accuracy and vertical resolution of the measurements, its all-weather 


9 



99 


capability, i.e., the technology is not affected by clouds or precipitation, and the fact that the 
accuracy of the measurements is equivalent over land and ocean. Furthermore, because the GPS 
RO observations are unbiased, their assimilation into NOAA’s models enhances the use of 
satellite radiances by preventing model drift away from reality. RO has been shown to improve 
NCEP’s forecast skill by 8 hours starting at day 4, and increasing to more hours of gain at 
extended forecasts. 

Although GPS RO provides a valuable augmentation, it is not a replacement for JPSS or GOES- 
R capabilities, which are fundamental to the weather forecast. Thus, NOAA will primarily 
utilize its operational polar-orbiting and geostationary satellites (e.g., JPSS and GOES-R Series) 
for forecasting, while the GPS RO capability will greatly complement those data sets in the 
numerical weather forecasting models. 

15) One recent report to NOAA suggests using data from Chinese weather satellites to 
address the looming data gap. What funding will NOAA require to build ingest 
systems and assimilation techniques to use this data. 

Response: NOAA does not have an estimate of what it would take to ingest and assimilate data 
from Chinese weather satellites. 

b. Would commercial data purchases help NOAA avoid having to rely on foreign 
nations for such critical data going forward? 

Response b: Commercial data that meets NOAA requirements, when available, can fill gaps in 
satellite coverage and potentially replace foreign sources. For example, NOAA met some of its 
needs for satellite ocean color data in the early 2000s by purchasing ocean color imagery from 
Orbital Imaging Corporation of Dulles, Virginia. The Sea-Viewing Wide Field-of-View Sensor 
(SeaWiFS) ocean color imager flew on the Orbview-2 satellite, launched in 1 997. It was a one- 
of-a-kind demonstration of a commercial satellite concept, largely subsidized by NASA. 
Orbview-2 is no longer operating, however, it is a good example of a case where NOAA relied 
on a commercial company to meet some of its data needs. Currently, there are no commercial 
sources of data that would address any potential gap in coverage of critical temperature and 
water vapor measurements from polar-orbiting satellites in the afternoon or any other orbit. 

16) Other federal agencies, including NASA, the National Geospatial Intelligence Agency 
(NGA), the Department of Homeland Security (DHS) and the Farm Services Agency 
(FSA), routinely purchase commercial data to meet their requirements, oftentimes at 
lower cost than in-house collection methods. The Space Act has spawned a new 
commercial launch industry'. Satellite imagery, through NGA, is now very 
commercial, and DoD procures a preponderance of satellite bandwidth from 
commercial satellite operators worldwide. 

a. Why has NOAA not followed these successful models? 

Response a: To meet mission requirements, NOAA engages in data buys and exchanges in 
accordance with the requirements of the Federal Acquisition Regulation, applicable 
appropriation laws, and US Government policy. NESDIS does not have a budget line dedicated 
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to purchasing commercial environmental data, although NESDIS has used funding in program- 
specific budget lines to acquire data where needed. 

NOAA has and will continue to purchase commercial data as needed, using existing program 
budgets. NOAA has worked with NGA, DHS, USDA, and other federal agencies to leverage 
commercial sources of high-resolution imagery data to meet some of NOAA’s needs for satellite 
imagery of US coastal and watershed areas and coral reef monitoring in marine protected areas, 
ocean color for seafood safety, and synthetic aperture radar (SAR) data for tracking sea 
ice. SeaWiFS is a good example of NOAA having acquired commercial data to meet its 
requirements, rather than making use of a Government-developed capability. NOAA also 
purchases SAR data to meet its needs for safe navigation in ice infested waters. While high- 
resolution commercial imagery is readily available to meet some of our research needs for 
coastal, watershed, and coral reef monitoring, other more operationally critical measurements, 
such as temperature and water vapor profiles required for weather modeling are not presently 
commercially available. 

In the area of data relay and transmission, NOAA has also used bandwidth from commercial 
satellite companies quite successfully for nearly 40 years, in order to relay NOAA satellite data 
from remote ground stations in Virginia and Alaska to the NOAA Satellite Operations Facility in 
Suitland, Maryland. In addition, NOAA relies on commercial satellite communications providers 
to relay critical weather forecast and warning data to users of the NOAA Advanced Weather 
Interactive Processing System (AWIPS), at weather forecast offices, national centers, and 
regional offices throughout the US and its territories. All AWIPS data streams, which include 
weather model forecasts and NOAA satellite imagery and products, are currently transmitted to a 
Master Ground Station for uplink to SpaceNet 4, a GTE communications satellite. SpaceNet 4 
then broadcasts these data to satellite receiver antennas at AWIPS sites and private sector sites. 

b. What steps is NOAA taking to engage commercial providers to prepare for a 
potential gap and avoid having to rely on foreign nations for such critical data? 

Response b: As stated above, NOAA uses commercial data when necessary and available. 
NOAA has relied on commercial satellite communications capabilities for several decades. 
NOAA meets regularly with commercial providers to discuss the latest developments and 
proposals in commercial capabilities. For example, from 2007 to 2010, NOAA conducted a 
series of requests for information from industry regarding the technical and price feasibility of 
providing satellite measurements to meet NOAA requirements. In addition, NOAA awarded 
several study contracts to companies with potentially viable solutions and documented this effort 
in a Report to Congress in 2010. 2 NOAA continues to engage with the commercial sector and is 
currently conducting an initiative to assess commercial solutions as part of its overall Analysis of 
Alternatives in 2014. NOAA will seek commercial solutions as their data meet NOAA 
requirements. 


2 “Acquisition of Space-based Scientific Data from Commercial Sources to Supplement NOAA’s Weather and 
Climate Observation Requirements.” [http://www.space.commerce.gov/library/reports/20 1 0-03-commercial- 
observations.pdf] 
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c. How many of the viable U.S. commercial providers for satellite data do you intend to 
bring under contract in the next three to five years? 

Response c: Presently there are no viable US commercial providers of satellite data, other than 
DigitalGlobe for high spatial resolution with very narrow coverage land and coastal imagery. 
NOAA’s investigations have shown that commercial solutions proposed to us thus far only have 
a viable business case if the Government is the sole/primary customer. They have also shown 
that most proposed commercial capabilities provide a narrow subset of observations (i.e., a single 
measurement) compared to existing and planned Government solutions that provide for multiple 
measurements. NOAA continues to meet with US commercial providers that are proposing new 
capabilities to determine how they may meet requirements as they become available. Until such 
capability is available, and demonstrated to meet our mission needs on commercial terms, 

NOAA has no basis to establish a plan for any contracting. 
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Responses by Mr. Marcus Watkins 

HOUSE COMMITTEE ON SCIENCE, SPACE, AND TECHNOLOGY 
SUBCOMMITTEE ON OVERSIGHT 
AND 

SUBCOMMITTEE ON ENVIRONMENT 

"Dysfunction in Management of Weather and Climate Satellites" 

QUESTIONS FOR THE RECORD 

Mr. M a rcus Watkins. Director 
Joint Agency Satellite Division. NASA 

Questions submitted by Chairman Paul Broun 

1) A lot of new responsibilities have been assigned to NASA, particularly for 

climate science research. The transfer of responsibility for three climate sensors 
from NOAA came with a one-time $40 million increase. But Dr. Michael 
Freilich, the Director of the Earth Science Division, expressed concern about the 
long term impact of taking on so many new responsibilities if adequate resources 
were not provided over the long term. 

a. How does NASA expect to pay for these new activities in the long term? 

As we have done successfully over the decades, NASA will advance an Earth 
Science and Applications program which will balance a range of spacebome 
measurements, scientific research and applications development to redeem and 
fully utilize the nation’s investment in the measurements, and technology 
development to assure our Nation’s leadership in future Earth observations and 
environmental information products. In developing the specific program details 
and approaches consistent with available resources and National priorities, NASA 
will coordinate closely with the National Academy of Sciences’ standing 
committees and the NASA Advisory Council. 

b. Does NASA have any concerns about taking on these new 
responsibilities? If so, what are they? 

No. NASA will continue to provide a balanced program of observations, 
research, and applications as called for by the Decadal Survey. The Earth Science 
Division will leverage opportunities for efficiency across the entire portfolio, and 
will similarly continue to pursue interagency and international partnerships to 
provide an excellent suite of home planet missions. 
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c. Why would NASA's ownership of these instruments be better than the 
current arrangement under which NASA is building the instruments 
for NOAA? 

The Earth Science Division (ESD) of the Science Mission Directorate (SMD) has 
the responsibility for design, implementation, and exploitation of Earth-related 
missions that are funded by NASA. By designing the measurement system 
architecture and implementing these measurements in ESD, the nation will benefit 
from the largest potential solution set for acquiring the needed data effectively 
and efficiently, leveraging maximum synergy by making use of the entire ESD 
portfolio of missions and techniques. 


d. Would NASA be better off letting agencies like NOAA, the U.S. 
Geological Survey (USGS) or the National Science Foundation (NSF) 
take over earth science research, thus freeing up the agency to explore 
space and develop game-changing technologies? 

Global, high-quality measurements of our home planet - available only from 
space missions - are essential for Earth science research and operational 
forecasting by civil and military agencies. NASA has the technical expertise and 
experience in building systems to make these accurate Earth observations from 
space. Using this unique vantage point, NASA conducts ground-breaking research 
which is not duplicated by any other agency in the U.S. government or the rest of 
the world. NASA pioneered the field of Earth System Science, and continues to 
lead that field today. It is precisely because of NASA’s ongoing R&D 
investments in Earth Science that NASA is capable of building the latest 
generations of operational satellites for NOAA and USGS. 

Through our incomparable constellation of Earth-observing satellites that provide 
the global view and that measure many of the important variables, NASA is 
providing to the Nation - to researchers, policy-makers, and the private sector - 
critical information on the evolution of our planet’s environment. This 
information is essential for developing sound policy, for predicting what might 
happen in the future and thus guiding mitigation and adaptation approaches, and 
for allowing the Nation to take advantage of the economic, societal, and 
developmental opportunities that will likely present themselves as Earth’s 
environment changes. 

2) The Earth Science Division budget increased from $1.2 billion in FY 2008 to 
$1.8 billion (requested) for FY 2014. Is there a trend within NASA to make 
climate research a priority over weather research? 


No. The FY 2008 budget cited in your question was a low point in Earth Science 
funding, measuring some 30 percent below the FY 2000 funding levels referenced in 
the most recent NRC Decadal Survey for Earth Science. The reductions from F Y 2000- 
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2008 caused a substantial degradation in the Nation’s Earth observation capabilities, 
impacting both research and operational agencies, and resulted in the National Research 
Council issuing several warnings and recommendations to revitalize the Earth 
observing satellite system. The present F Y 2014 budget request, while below the FY 
2000 level in constant dollars, continues the revitalization has begun over the past five 
years. 

The objectives of NASA’s Earth Science Division are to advance Earth System Science 
- the understanding of the Earth as an integrated system - and to develop and test 
applications that deliver direct societal benefit from the satellite measurements. The 
satellite systems we have launched contribute to operational forecasting and provide 
direct societal benefit, in addition to advancing Earth System Science research and 
climate studies. 

To achieve these goals and to assure that research and missions cover all aspects of the 
complex Earth system, NASA’s Earth Science research portfolio is organized into 6 
partially overlapping, interdisciplinary, thematic focus areas: 1) Atmospheric 
composition; 2) Carbon cycle, ecosystems, and biogeochemistry; 3) Water and energy 
cycles; 4) Weather; 5) Climate variability and change; and 6) Earth surface and interior. 
The Applied Sciences Program within the Earth Science Division focuses primarily on 
developing applications and building user-group capacity using satellite-derived 
information products in the areas of Health, Water Availability and Quality, Disaster 
Response, and Ecosystems. 

Funding trends in the Earth Science Division support the balanced program called for 
by the National Research Council’s Decadal Survey and do not represent significant 
changes in emphasis among the thematic focus areas or the societal benefit areas. 


3) A Congressional Research Service report released in September indicates that 
in the President's FY 2014 request, NASA would contribute more than half of 
the $1.5 billion total of the Global Change Research program, which is an 
interagency climate research program among 13 federal bodies. This is 
roughly 50 percent higher than NASA's contribution in 2008. 

a. What explains this dramatic growth? As this number does not include 
some climate activities at NASA Earth Science, what is the total 
spending by NASA on climate change research? 

NASA has preserved a balanced program of satellites, research, and applications 
development as its budget has grown Many of these missions contribute directly to 
increased accuracy of weather forecasts and related operational environmental 
predictions by NOAA, USGS, and other agencies as well as to Earth System Science 
research, including the climate change research. Owing to the long-standing formula pre- 
dating the present Administration by which USGCRP funding is calculated, substantial 
costs of most of NASA’s Earth Observation missions are considered in the cross-agency 
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USGCRP base, while the costs of the NO AA weather satellites - which similarly 
contribute both to operational prediction and Earth System Science research - are not 
counted. NASA’s fractional contribution to the USGCRP cross-cut has not changed 
substantially since 2008. 

4) What are NASA's thoughts about NOAA's contingency plan for the polar 
afternoon orbit is the agency comfortable with the reduced satellites and 
instruments? Is this the best plan that budgets can afford? Does it meet the 
needs of the nation and of those who rely on weather data? 

NOAA is responsible for the nation’s polar satellite program, and NASA serves as its 
acquisition agent Thus, the requirements and funding profile are defined by NOAA and 
are provided to NASA, including the number of satellites and instruments. NASA has 
developed the optimum implementation plan to meet those requirements within the 
funding profile provided. 

5) If NOAA decides that collaboration with China is the best way forward in the 
event of a data gap in the JPSS program, how much leverage docs NASA have 
in that decision-making process? How confident are you that NASA's concerns 
would be adequately addressed? 

NOAA is responsible for the nation’s polar satellite program and has the final decision- 
making authority about the mitigation strategy and plan for a potential data gap. NASA 
serves as NOAA’s acquisition agent and implements NOAA’s requirements. While 
NASA applies its extensive experience in satellite development and operations to advise 
NOAA where appropriate, NASA docs not have the decision-making authority. 

6) How long can the weather satellites currently in orbit be used to gather data? 
How reliable is that data? Is there any degradation to the sensors due to time 
in orbit? 

The NOAA-19, NOAA-15, NOAA-16, NOAA-18, NASA’s Aqua and the European 
MetOp A satellites are all in extended mission and are still providing useful data. The 
Suomi-NPP satellite was launched on October 28, 2011, with a prime mission through 
2016, and MetOp B’s primary mission ends in 2017. While satellite instruments are 
subject to degradation over time, those included on the missions listed above are still in 
operation and are working and providing accurate operational data. 

The Suomi-NPP spacecraft was designed with redundancy to meet a five-year mission 
life. All Suomi-NPP instruments were designed with redundancy to meet the NPOESS 
seven-year mission life, except for the CERES FM-5 instrument single string design, 
which has a five-year mission life, based on the heritage Earth Observing System (EOS) 
Program requirements. The Suomi-NPP launch vehicle provided a direct insertion orbit 
that required only minimal orbit adjustments to reach the final mission orbit. As a result, 
there is now additional propulsion system fuel margin to extend the mission until 2023. . 
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7) In your written statement, you state that with respect to the Suomi-NPP, the 
JPSS program is now reaching the end of a planned validation period of the 
new sensors and data products. It is our understanding, however, that the 
program had originally intended to be able to deliver 76 precise data products 
18-24 months after launching S-NPP. However, only 18 products were 
validated for operational use by the end of September, another 35 by 
September 2014, and another one by September 2015, two years later than 
planned. What has caused the delay in the validation process? 

The National Polar Orbiting Environmental Satellite System (NPOESS) program 
schedule had the products completing validation at 24 months post-launch (i.e., October 
2013), which was based on a calibration and validation (cal/val) schedule originally 
developed in 2008 that assumed full funding and was developed for the NPOESS product 
baseline. The JPSS cal/val schedule, baselined after the launch of Suomi-NPP, factored 
in the JPSS Level- 1 requirements, actual funding in FY 2010-2012, which was below 
what was expected, and the transfer of algorithm development activities from Northrup 
Grumman to JPSS. Against this baseline, JPSS is on target to complete validation 
activities consistent with its cal/val schedule and Algorithm Maturity Matrix. 
Additionally, the JPSS Program, in consultation with the user community, has set 
priorities for the calibration/validation schedule, and the highest priority products have 
been validated and are being used by the operational users. 
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HOUSE COMMITTEE ON SCIENCE, SPACE, AND TECHNOLOGY 
SUBCOMMITTEE ON OVERSIGHT 
AND 

SUBCOMMITTEE ON ENVIRONMENT 


"Dysfunction in Management of Weather and Climate Satellites" 
QUESTIONS FOR THE RECORD 


Question Submitted by Rep. Bill Posey (R-FL) 

1) During our September 19, 2013 hearing on the "Dysfunction in Management of 
Weather and Climate Satellites" where you appeared as a witness, I noted that a 
large solar prominence had occurred just a few weeks prior to the hearing, 
sending a large electromagnetic pulse out into space. The Earth was not affected 
because the flare did not happen to occur in the direction of the Earth. However, 
news reports stated that if the solar prominence had appeared just two weeks 
earlier, the Earth would have been directly in its path. 

a. I would like NASA to provide me with an estimate on the effects of the 
solar prominence if it had occurred two weeks earlier and the Earth had 
been in its path. Specifically, I would like to receive NASA's estimate on 
the impact of the solar prominence on our fleet of orbiting satellites, on the 
International Space Station, on our electrical infrastructure, IT 
infrastructure and transportation. What other systems would it have 
affected and what would the extent of that affect be? 

b. Finally, I would like to know what the level of disruption from the solar 
prominence would have been. Would the effect have been localized or 
worldwide? 

On August 20, 2013, there was a solar event, a coronal mass ejection (CME), which was 
reported by several organizations and the press. Coupled with information from NOAA's 
Space Weather Prediction Center, we are able to provide the following information about 
that particular event. 

The analysis of images and other observations from NASA’s Solar Terrestrial Relations 
Observatory (STEREO) showed that the August 20 th CME was a modest event that left 
the sun at a speed of approximately 570 miles per second. This is a fairly typical speed 
for CMEs. The edge of this CME had a glancing blow at Earth. Subsequent effects at 
Earth were not particularly notable, with somewhat enhanced aurora and a maximum 
value of the planetary-scale geomagnetic storm index, Kp, of 4 on a scale of 1 to 9. 

Events of this severity occur many times per year and our space and ground-based 
systems are designed to operate well through these conditions. Based on our experience 
with similar CMEs, even a full-on impact at Earth would likely generate only moderate 
geomagnetic storms in severity and duration. Since we are currently in solar maximum, 
the peak of the 1 1-year cycle of solar activity, we expect strong solar events and 
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geomagnetic storms to occur more frequently. However, this solar maximum has so far 
been unusually quiescent. 

Historically speaking, geomagnetic storms triggered by higher speed and density CMEs 
(for example, a CME of over 1500 miles per second) can interfere with high-frequency 
radio communication and satellite navigation (such as GPS) and cause unexpected 
electrical surges in power grids here on the Earth. They can also cause the visible aurora, 
commonly known as the northern or southern lights, which are seen in high latitudes near 
the north and south poles. Increases in density and energy of the plasma environment 
around satellites due to geomagnetic activity can lead to electrostatic discharge 
potentially degrading performance, introducing false commands, or even physically 
damaging critical systems. 

NASA actively works with NOAA's Space Weather Prediction Center (SWPC) 
(http://swpc.noaa.gov), which serves as the U.S. government's official source for space 
weather forecasts, alerts, watches and warnings. SWPC's work helps the operators of 
spacecraft, the International Space Station, power grids and other potentially affected 
infrastructure prepare for and protect against space weather impacts. If warranted, 
operators can put spacecraft into a safe mode to protect critical systems from the solar 
event. 
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Why GAO Did This Study 

NOAA, with the aid of tho National 
Aeronautics and Space Administration 
(NASA), is procuring the next 
generation of geostationary weather 
satellites. The GOES-R series Is to 
replace th e current series of satellites 
(called GOES 13, -1 4 , and -15), which 
will likely begin to reach the end of 
their useful lives in 2015. This new 
series is considered critical to the 
United States' ability to maintain the 
.continuity, of. satellite data required for 
weather forecasting through 2036. 

GAO was asked to evaluate GOES-R. 
GAO's objectives were to (1) assess 
i GOES-R progress and efforts to 
addi ess key cost and schedule risks; 

(2) evaluate efforts to manage cf ranges 
in requirements and whether any 
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contingency planning NOAA 
concurred with GAO's 


GEOSTATIONARY WEATHER SATELLITES 

Progress Made, but Weaknesses in Scheduling, 
Contingency Planning, and Communicating with 
Users Need to Be Addressed 


What GAO Found 

The National Oceanic and Atmospheric Administration (NOAA) has completed 
the design of its Geostationary Operational Environmental Satellite-R (GOES-R) 
series and made progress in building flight and ground components. While the 
program reports that it is on track to stay within its $10.9 billion life cycle cost 
estimate, it has not reported key information on reserve funds to senior 
management. Also, the program has delayed interim milestones, is experiencing 
technical issues, and continues to demonstrate weaknesses in the development 
of component schedules. These factors have the potential to affect the expected 
October 2015 launch date of the first GOES-R satellite, and program officials 
now acknowledge that the launch date may be delayed by 6 months, A launch 
delay would increase the time that NOAA is without an on-orbit backup satellite. 
It would also increase the potential for a gap in GOES satellite coverage should 
one of the two operational satellites (GOES-14 or -15) fail prematurely (see 
graphic) — a scenario given a 36 percent likelihood of occurring by an 
independent review team. 



Source; GAO analysis of NOAA data. 


While the GOES-R program has established a process for managing 
requirements changes, it has not effectively involved key satellite data users. 
Since 2007, the GOES-R program decided not to develop 31 of the original set of 
GOES products and modified specifications on 20 remaining products. For 
example, NOAA decreased the accuracy requirement for the hurricane intensity 
product and decreased the timeliness of the lightning detection product. 

However, key satellite data users were not fully informed about changes and did 
not have a chance to communicate their concerns about the impact of these 
changes on their operations. Until NOAA improves its communication with 
external satellite data users, obtains input from the users, and addresses user 
concerns when considering product changes, its changes could cause an 
unexpected impact on critical user operations. 

NOAA has established contingency plans for the loss of its GOES satellites and 
ground systems that are generally in accordance with best practices; however, 
these plans are missing key elements. For example, NOAA did not work with the 
user community to address potential reductions in capability under contingency 
scenarios or identify alternative solutions for preventing a delay in the GOES-R 
launch date. Until NOAA addresses the shortfalls in its contingency plans and 
procedures, the plans may not work as intended in an emergency and satellite 
data users may not obtain the information they need to perform their missions. 
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GAO 

441 G St. N.W. 
Washington, DC 20548 


GOVERNMENT ACCOUNTABILITY OFFICE 


September 9, 2013 

The Honorable Lamar S. Smith 
Chairman 

The Honorable Ralph Hail 
Chairman Emeritus 

The Honorable Eddie Bernice Johnson 
Ranking Member 

Committee on Science, Space, and Technology 
House of Representatives 

Geostationary environmental satellites play a critical role in our nation’s 
weather forecasting. These satellites — which are managed by the 
Department of Commerce’s National Oceanic and Atmospheric 
Administration (NOAA) — provide information on atmospheric, oceanic, 
climatic, and solar conditions that help meteorologists observe and 
predict regional and local weather events. They also provide a means of 
identifying the large-scale evolution of severe storms, such as forecasting 
a hurricane’s path and intensity. 

NOAA, through collaboration with the National Aeronautics and Space 
Administration (NASA), is procuring the next generation of geostationary 
weather satellites, called the Geostationary Operational Environmental 
Satellite-R (GOES-R) series. The GOES-R series consists of four 
satellites and is to replace the current series of geostationary 
environmental satellites as they reach the end of their useful lives. This 
new series is expected to provide the first major improvement in the 
technology of GOES instruments since 1994 and, as such, is considered 
critical to the United States' ability to maintain the continuity of data 
required for weather forecasting through the year 2036. 

This report responds to your request that we review NOAA’s GOES-R 
series program (GOES-R program). Specifically, our objectives were to 
(1) assess GOES-R progress and efforts to address key cost and 
schedule risks that we identified in our prior report, (2) evaluate efforts to 
manage changes in requirements and whether any significant changes 
have recently occurred, and (3) evaluate the adequacy of GOES-R 
contingency plans. To assess NOAA’s progress in developing GOES-R 
and addressing key risks, we compared estimated and actual program 
deliverables and analyzed monthly program status briefings to identify 
current status and recent development challenges. We also followed up 
on our prior concerns regarding reserve funds and scheduling practices 
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by comparing the program’s current level of reserve funding and two 
component schedules to best practices, 1 By recalculating reserve 
percentages based on supporting data and examining schedule 
anomalies through use of a standard template, we determined data in 
both areas to be reliable for the purposes of this audit. To assess NOAA’s 
efforts to manage changes in requirements, we compared the agency’s 
policies and practices to best practices identified by leading 
organizations 2 and identified major changes to the program overtime. To 
evaluate the adequacy of the GOES-R contingency plan, we compared 
the GOES-R contingency plan to best practices in contingency planning 
identified by leading organizations. 3 We also interviewed program officials 
as well as key internal and external satellite data users. 

We conducted this performance audit from October 2012 to September 
2013 in accordance with generally accepted government auditing 
standards. Those standards require that we plan and perform the audit to 
obtain sufficient, appropriate evidence to provide a reasonable basis for 
our findings and conclusions based on our audit objectives. We believe 
that the evidence obtained provides a reasonable basis for our findings 
and conclusions based on our audit objectives. See appendix I for a 
complete description of our objectives, scope, and methodology. 


1 GAO, GAO Cost Estimating and Assessment Guide: Best Practices for Developing and 
Managing Capital Program Costs, GAO-09-3SP (Washington, DC.: Mar. 2009); NOAA, 
Geostationary Operational Environmental Satellites— R Series Management Control Plan 
(Silver Spring, Md.: January 2013). 

2 NASA, NASA Systems Engineering Handbook (Washington, D.C.: December 2007), 
Software Engineering Institute, CMMI® for Development, Version 1.3 (Pittsburgh, Pa.: 
November 2010); Project Management Institute, A Guide to the Project Management 
Body of Knowledge (Newtown Square, Pa.: 2004); GAO, Federal Information System 
Controls Audit Manual, GAO-09-232G (Washington, D C.: February 2009); IT Governance 
Institute, Control Objectives for Information and related Technology 4.1 (Rolling Meadows, 
III.: 2007). 

3 GAO, Year 2000 Computing Crisis: Business Continuity and Contingency Planning, 
GAO/AIMD-IO.1.19 (Washington, D C.: August 1998); National Institute of Standards and 
Technology, Contingency Planning Guide for Federal Information Systems, NIST 800-34 
(Gaithersburg, Md.: May 2010); Software Engineering Institute, CMMI® for Acquisition, 
Version 1 .3 (Pittsburgh, Pa.: November 2010). 


Page 2 


GAO-13-597 Geostationary Weather Satellites 



Background 


Since the 1970s, geostationary satellites have been used by the United 
States to provide meteorological data for weather observation, research, 
and forecasting. NOAA’s National Environmental Satellite, Data, and 
Information Service is responsible for managing the civilian operational 
geostationary satellite system, called GOES. Geostationary satellites can 
maintain a constant view of the earth from a high orbit of about 22,300 
miles in space. 

NOAA operates GOES as a two-satellite system that is primarily focused 
on the United States (see fig. 1). These satellites provide timely 
environmental data about the earth’s atmosphere, surface, cloud cover, 
and the space environment to meteorologists and their audiences. They 
also observe the development of hazardous weather, such as hurricanes 
and severe thunderstorms, and track their movement and intensity to 
reduce or avoid major losses of property and life. The ability of the 
satellites to provide broad, continuously updated coverage of atmospheric 
conditions over land and oceans is important to NOAA’s weather 
forecasting operations. 
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Figure 1 : Approximate Geographic Coverage of the Geostationary Operational Environmental Satellites 



Sources: NOAA (data). Mapart (inap) 


To provide continuous satellite coverage, NOAA acquires several 
satellites at a time as part of a series and launches new satellites every 
few years (see table 1). NOAA’s policy is to have two operational 
satellites and one backup satellite in orbit at all times. 
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Table 1 : Summary of the Procurement History of the Geostationary Operational 
Environmental Satellites 

Series name 

Procurement duration 3 

Satellites” 

Original GOES c 

1970-1987 

1,2, 3, 4, 5, 6,7 

GOES l-M 

1985-2001 

8, 9, 10, 11, 12 

GOES N 

1998-2010 

13, 14, 15, Q“ 

GOES-R 

2008-2024 

R, S, T, U 


Source: GAO analysis of NOAA data. 

’Duration indudes time from contract award to final satellite launch. 

b SateiIites in a series are identified by letters of the alphabet when they are on the ground (before 
launch) and by numbers once they are in orbit. 

'The procurement of these satellites consisted of four separate contracts for (1 ) two early prototype 
satellites and GOES-1, (2) GOES-2 and -3, (3) GOES-4 through -6, and (4) GOES-G (failed on 
launch) and GOES-7. 

d NOAA decided not to exercise the option for this satellite. 

Four GOES satellites-GOES-12, GOES-13, GOES-14, and GOES-15- 
are currently in orbit. Both GOES-13 and GOES-15 are operational 
satellites with GOES-13 covering the eastern United States and GOES- 
15 in the western United States (see fig. 1). GOES-14 is currently in an 
on-orbit storage mode and available as a backup for the other two 
satellites should they experience any degradation in service. GOES-12 is 
at the end of its service life, but it is being used to provide limited 
coverage of South America. The GOES-R series is the next generation of 
satellites that NOAA is planning. The first two satellites in the series 
(called GOES-R and GOES-S) are planned for launch in October 2015 
and February 2017, respectively. 4 

Each of the operational geostationary satellites continuously transmits 
raw environmental data to NOAA ground stations. The data are 
processed at these ground stations and transmitted back to the satellite 
for broadcast to primary weather services and the global research 
community in the United States and abroad. Raw and processed data are 
also distributed to users via ground stations through other communication 
channels, such as dedicated private communication lines and the 


4 While our report was in final processing, NOAA announced that it would delay the launch 
dates for its GOES-R and GOES-S satellites to the second quarter of fiscal year 2016 and 
the third quarter of fiscal year 2017, respectively. 
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Internet. Figure 2 depicts a generic data relay pattern from a 
geostationary satellite to the ground stations and commercial terminals. 


Figure 2: Generic Data Relay Pattern for the Geostationary Operational 
Environmental Satellites 



Source: GAO analysis of NOAA data. 


Overview of the GOES-R NOAA established the GOES-R program to develop and launch the next 
Program series of geostationary satellites and to ensure the continuity of 

geostationary satellite observations. Since its inception, the GOES-R 
program has undergone several changes in cost and scope. As originally 
envisioned, GOES-R was to encompass four satellites hosting a variety of 
advanced technology instruments and providing 81 environmental 
products. The first two satellites in the series were expected to launch in 
September 2012 and April 2014. However, in September 2006, NOAA 
decided to reduce the scope and technical complexity of the GOES-R 
program because of expectations that total costs, which were originally 
estimated to be $6.2 billion, could reach $1 1.4 billion. Specifically, NOAA 
reduced the minimum number of satellites from four to two, cancelled 
plans for developing an advanced instrument (which reduced the number 
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of planned satellite products from 81 to 68), and divided another 
instrument into two separate acquisitions. The agency estimated that the 
revised program would cost $7 billion and kept the planned launch dates 
unchanged. 

Subsequently, NOAA made several other important decisions about the 
cost and scope of the GOES-R program. In May 2007, NOAA had an 
independent cost estimate completed for the GOES-R program. After 
reconciling the program office’s cost estimate of $7 billion with the 
independent cost estimate of about $9 billion, the agency established a 
new program cost estimate of $7.67 billion. This was an increase of $670 
million from the previous estimate. The program also moved the launch 
dates for the first two satellites to December 2014 and April 2016. 

Further, in November 2007, to mitigate the risk that costs would rise, 
program officials decided to remove selected program requirements from 
the baseline program and treat them as contract options that could be 
exercised if funds allowed. These requirements included the number of 
products to be distributed, the time to deliver the remaining products 
(product latency), and how often these products would be updated with 
new satellite data (refresh rate). For example, program officials eliminated 
the requirement to develop and distribute 34 of the 68 envisioned 
products, including low cloud and fog, sulfur dioxide detection, and cloud 
liquid water. Program officials included the restoration of the requirements 
for the products, latency times, and refresh rates as options in the ground 
system contract that could be acquired at a later time. Program officials 
later reduced the number of products that could be restored as a contract 
option (called option 2) from 34 to 31 because they determined that two 
products were no longer feasible and two others could be combined into a 
single product. 

In late 2009, NOAA changed the launch dates for the first two satellites to 
October 2015 and February 2017, in part due to a bid protest related to 
award of the spacecraft contract. More recently, NOAA restored two 
satellites to the program's baseline, making GOES-R a four-satellite 
program once again. In February 201 1 , as part of its fiscal year 2012 
budget request, NOAA requested funding to begin development for two 
additional satellites in the GOES-R series — GOES-T and GOES-U. The 
program estimates that the development for all four satellites in the 
GOES-R series — GOES-R, GOES-S, GOES-T, and GOES-U — is to cost 
$10.9 billion through 2036, an increase of $3.2 billion over its prior life 
cycle cost estimate of $7.67 billion for the two-satellite program. See table 
2 for an overview of key changes to the GOES-R program. 
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Table 2: Key Changes to the Geostationary Operational Environmental Sate!iite-R Series Program over Time 


August 2006 
(baseline program) 

September 2006 

November 2007 

February 2011 

Number of 
satellites 

4 

2 

2 

4 

Instruments or 

instrument 

changes 

. Advanced Baseline Imager 

« Geostationary Lightning Mapper 

• Magnetometer 

. Space Environmental in-Situ 
Suite 

• Solar Imaging Suite (which 
included the Solar Ultraviolet 
Imager, and Extreme 
Ultraviolet/X-Ray Irradiance 
Sensor) 

• Hyperspectral Environmental 
Suite 

• Advanced Baseline Imager 

• Geostationary Lightning Mapper 

• Magnetometer 

• Space Environmental In-Situ 
Suite 

. Solar Ultraviolet Imager 

• Extreme Ultraviolet/X-Ray 
Irradiance Sensor 

No change 

No change 

Number of 

satellite 

products 

81 

68 

34 baseline 

34 optional 

34 baseline 

31 optional 

Life cycle cost 
estimate (in 
then- year 
dollars) 

$6.2 billion — $1 1.4 billion (through 
2034) 

$7 billion (through 2028) 

$7.67 billion 
(through 2028) 

$10.9 billion 
(through 2036) a 

Estimated 
launch dates for 
GOES-R and S 

GOES-R: September 2012 

GOES-S: April 2014 

GOES-R: September 2012 

GOES-S: April 2014 

GOES-R: 

December 2014 

GOES-S: 

April 2016 

GOES-R: 

October 2015 
GOES-S: 
February 2017 


Source: GAO analysis of NOAA a ala. 

“Based on NOAA's fiscal year 2012 budget baseline, S7.64 billion of this cost estimate was for the 
first two satellites in the series, GOES-R and GOES-S. The cost for the remaining two satellites— 
GOES-T and GOES-U— was estimated at $3.22 billion. 


program and Program Office The GOES-R program is divided into flight and ground projects that have 
Structure separate areas of responsibility and oversee different sets of contracts. 

The flight project, which is managed by NASA, includes instruments, 
spacecraft, launch services, satellite integration, and on-orbit satellite 
initialization. Table 3 summarizes the GOES-R instruments and their 
planned capabilities. 
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Table 3: Geostationary Operational Environmental Satellite-R Series Instruments 

Planned instrument 

Description 

Advanced Baseline Imager 

Expected to provide variable area imagery and radiometric information of the earth’s surface, 
atmosphere, and cloud cover. Key features include 
« monitoring and tracking severe weather; 

• providing images of clouds to support forecasts; and 

« providing higher resolution, faster coverage, and broader coverage simultaneously. 

Geostationary Lightning 
Mapper 

Expected to continuously monitor total lightning (in-cloud and cloud-to-ground) activity over the 

United States and adjacent oceans and to provide a more complete dataset than previously 
possible. Key features include 

. detecting lightning activity as an indicator of severe storms and convective weather hazard 
impacts to aviation; and 

. providing a new capability to GOES for long-term mapping of total lightning that only 
previously existed on NASA low-earth-orbiting research satellites. 

Magnetometer 

Expected to provide information on the general level of geomagnetic activity, monitor current 
systems in space, and permit detection of magnetopause crossings, sudden storm 
commencements, and substorms. 

Space Environmental In-Situ 
Suite 

Expected to provide information on space weather to aid in the prediction of particle precipitation, 
which causes disturbance and disruption of radio communications and navigation systems. Key 
features include 

• measuring magnetic fields and charged particles; 

. providing improved heavy ion detection, adding low-energy electrons and protons; and 
. enabling early warnings for satellite and power grid operation, telecom services, astronauts, 
and airlines. 

Solar Ultraviolet Imager 

Expected to provide coverage of the entire dynamic range of solar X-ray features, from coronal 
holes to X-class flares, and will provide quantitative estimates of the physical conditions in the 

Sun's atmosphere. Key features include 

. providing information used for geomagnetic storm forecasts, and power grid performance; 
and 

. providing observations of solar energetic particle events related to flares. 

Extreme Ultraviolet/X-Ray 
Irradiance Sensor 

Expected to detect solar soft X-ray irradiance and solar extreme ultraviolet spectral irradiance. 

Key features include 

. monitoring solar flares that can disrupt communications and degrade navigational accuracy, 
affecting satellites, astronauts, high latitude airline passengers; and 
. monitoring solar variations that directly affect satellite drag/tracking and ionospheric changes, 
which impact communications and navigation operations. 


Source: GAO analysis of NOAA data. 


The ground project is directed by NOAA and is made up of three main 
components: the core ground system, an infrastructure of antennas, and 
a product access subsystem. In turn, the core ground system comprises 
four functional modules supporting operations, product generation, 
product distribution, and configuration control. Key components of the 
ground project are described in table 4. 
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Table 4: Key Components of the Geostationary Operational Environmental Sateiiite-R Series Ground Project 

Component 

Description 

Core Ground System 

Expected to (1) provide command of operational functions of the spacecraft and instruments, 

(2) receive and process information from the instruments and spacecraft, (3) distribute satellite 
data products to users, and (4) provide configuration control and a common infrastructure and 
set of services for the satellite and instruments. 

Antennas 

Expected to provide six new antenna stations and modify four existing antennas to receive 
GOES-R data. The antenna contract is also expected to indude the construction of related 
infrastructure, software development for control systems, and maintenance. 

Product Distribution and Access 
System 

Expected to provide ingestion of data and distribution for GOES-R products and data to 
authorized users. When completed, this system will be integrated into the core ground system. 


Source: GAO analysis of NOAA data. 


NOAA is responsible for GOES-R program funding and overall mission 
success. The NOAA Program Management Council, which is chaired by 
NOAA’s Deputy Undersecretary, is the oversight body for the GOES-R 
program. However, since it relies on NASA’s acquisition experience and 
technical expertise to help ensure the success of its programs, NOAA 
implemented an integrated program management structure with NASA for 
the GOES-R program (see fig. 3). NOAA also located the program office 
at NASA’s Goddard Space Flight Center. 
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Program Scientist 
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Project Manager. NASA 


Communicates with 


Source: NOAA. 


Figure 3: Organizational Structure and Staffing of the Geostationary Operational 
Environmental Sateltite-R Series Program 
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Prior Reports Made 
Recommendations to 
Address Program 
Weaknesses 


In recent years, we issued a series of reports aimed at addressing 
weaknesses in the GOES-R program. 5 Key areas of focus included (1) 
improving communications with external data users, (2) developing 
contingency plans, and (3) addressing key cost and schedule risks. 

• Improving communications with external users. In September 
2010, we reported that while NOAA had identified GOES data users 
and involved internal NOAA users in developing and prioritizing 
GOES-R requirements, it had not adequately involved other federal 
users who rely on GOES data by documenting their input and 
communicating major changes to the program. 6 We recommended 
that the program establish processes for satellite data requirements 
definition and prioritization that include documented input from 
external users, as well as processes to notify these non-NOAA 
agencies of GOES-R program status and changes. In February 2012, 
the GOES-R program developed a communications plan that 
described how external stakeholders would be notified of GOES-R 
progress, status changes, and other relevant activities. However, 
NOAA has not yet fully implemented the plan, as demonstrated by the 
communication shortfalls discussed later in this report. 

• Developing contingency plans. In September 2010, we reported 
that while there was a potential gap in backup coverage due to 


5 GAO, Environmental Satellites: Focused Attention Needed to Mitigate Program Risks, 
GAO-1 2-841T, (Washington, D.C.: June 27, 2012); GAO, Geostationary Weather 
Satellites: Design Progress Made, but Schedule Uncertainty Needs to be Addressed, 
GAO-12-576, (Washington, D.C.; June 26, 2012); GAO, Geostationary Operational 
Environmental Satellites: Improvements Needed in Continuity Planning and Involvement 
of Key Users, GAO-10-799 (Washington, DC.: Sept. 1, 2010); GAO, Geostationary 
Operational Environmental Satellites: Acquisition Has Increased Costs, Reduced 
Capabilities, and Delayed Schedules, GAO-09-596T (Washington, D C.: Apr. 23, 2009); 
GAO, Geostationary Operational Environmental Satellites: Acquisition Is UnderWay, but 
Improvements Needed in Management and Oversight, GAO-Q9-323 (Washington, D.C.: 
Apr. 2, 2009); GAO, Geostationary Operational Environmental Satellites: Further Actions 
Needed to Effectively Manage Risks , GAO-08- 183T (Washington, D.C.: Oct. 23, 2007); 
GAO, Geostationary Operational Environmental Satellites . Progress Has Been Made, but 
Improvements Are Needed to Effectively Manage Risks, GAO-08-18 (Washington, D.C.: 
Oct. 23, 2007); GAO, Geostationary Operational Environmental Satellites: Additional 
Action Needed to Incorporate Lessons Learned from Other Satellite Programs, 

GAO-06- 1129T (Washington, D C.: Sept. 29, 2006); and GAO, Geostationary Operational 
Environmental Satellites: Steps Remain in Incorporating Lessons Learned from Other 
Satellite Programs, GAO-06-993 (Washington, D.C.: Sept. 6, 2006). 

6 GAO-10-799. 
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satellite launch delays, NOAA had not established adequate continuity 
plans for its geostationary satellites. 7 We recommended that the 
program’s plan include implementation procedures, resources, staff 
roles, and timetables needed to transition to a single satellite, a 
foreign satellite, or other solution. In December 2012, NOAA finalized 
a contingency plan that generally included these elements. However, 
more work remains to ensure that the plan is viable. 

More recently, in February 2013, we added the potential gaps in 
weather satellite data to our biennial High-Risk list. 8 In that report, we 
noted that NOAA had established a contingency plan for a potential 
gap in the GOES program, but it needed to demonstrate its progress 
in coordinating with the user community to determine their most 
critical requirements, conducting training and simulations for 
contingency operations scenarios, evaluating the status of viable 
foreign satellites, and working with the user community to account for 
differences in product coverage under contingency operations 
scenarios. We also stated that NOAA should update its contingency 
plan to provide more details on its contingency scenarios, associated 
time frames, and any preventative actions it is taking to minimize the 
possibility of a gap. 

• Addressing key cost and schedule risks. In June 2012, we 

reported that the GOES-R program might not be able to ensure that it 
had adequate resources to cover unexpected problems in remaining 
development, and that unresolved schedule deficiencies existed in its 
integrated master schedule and contractor schedules. We also 
reported that the program estimated a 48 percent chance that the 
planned GOES-R launch date of October 2015 would be reached. 9 
We recommended that the program assess and report on the 
reserves needed for completing remaining development for each 
satellite in the series, and address shortfalls in the schedule 
management practices we identified such as eliminating unnecessary 
constraints and creating a realistic allocation of resources, in order to 
minimize the likelihood of a potential gap. The agency agreed with 


7 GAO-IO-799. 

8 GAO, 2013 High-Risk Series: An Update, GAO-13-359T (Washington, D.C.: February 
14, 2013). 

9 GAO-12-756. 
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these recommendations and took steps to address them by identifying 
needed reserve levels and refining program schedules. 


NOAAHas Made 
Progress in 
Developing GOES-R, 
but Continues to Face 
Challenges that Could 
Increase the Risk of a 
Satellite Data Gap 


NOAA has completed its design of the GOES-R program, and has made 
progress in building components of the flight and ground segments. 
Program officials also report that the program is operating within its 
estimated budget of $10.9 billion. However, key information on reserves 
has not been reported to management. Further, both the flight and ground 
segments have experienced delays in achieving major milestones due to 
technical challenges, and weaknesses in the development of master 
schedules could cause further delays. Program officials stated that they 
have made improvements on how they manage cost reserves and 
schedules, but acknowledged that there will always be opportunities for 
improvement because the reserves and schedules are so dynamic on a 
big program like GOES-R. These challenges have the potential to impact 
the expected launch date of the first GOES-R satellite, which would delay 
the availability of an on-orbit backup and increase the potential for a gap 
in GOES satellite coverage should either of the two operational satellites 
fail prematurely. 


Program Has Completed 
Design and Begun Building 
Components of the First 
Satellite 


NASA and NOAA are following NASA’s standard space system life cycle 
on the GOES-R program. This life cycle includes distinct phases, 
including concept and technology development; preliminary design and 
technology completion; final design and fabrication, system assembly, 
integration and testing, launch and checkout; and operations and 
sustainment. There are key program reviews throughout each of the 
phases, including preliminary design review, critical design review, and 
system integration review. NOAA and NASA jointly conduct key reviews 
on the flight and ground segments individually as well as for the program 
as a whole, and then make decisions on whether to proceed to the next 
phase. Figure 4 provides an overview of the life cycle phases, key 
program reviews, and associated decision milestones. In addition, the key 
reviews are described in table 5. 
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Figure 4: NASA’s Life Cycle for Flight Systems 


KDPC 

(confirmation review) 


KDP A KDP B Program Start KDP D KDP E KDP F 
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Management decision reviews 


▼ KDP = key decision point 


Technical reviews 

i SDR/MDR = system definition review/mission definition review 
| PDR = preliminary design review 
j CDR = critical design review 
i MOR =. mission operations review 
S SIR = system integration review 
I FOR = flight operations reviow 
f ORR = operational readiness review 


Source: NASA dale and GAO analyss. 

Note: According to a NASA official, the MOR and FOR are considered lower-level reviews and are 
not mandated by NASA’s primary procedural requirements. They are, however, key mission reviews 
required by NASA’s Goddard Space Right Center. 


Table 5: Major Development Reviews for the Geostationary Operational Environmental Satellite-R Series 

Review 

Description 

System Definition 

Review 

Performed on the flight and ground segments individually, and then on the program as a whole, 
this review is to examine the proposed system architecture/design and demonstrate that a system 
that fulfills the mission objectives can be built within existing constraints. 

Preliminary Design Review 

Performed on the flight and ground segments individually, and then on the program as a whole, 
this review is to demonstrate that the preliminary design meets all system requirements with 
acceptable risk and within the cost and schedule constraints and to establish the basis for 
proceeding with detailed design. 

Critical Design Review 

Performed on the flight and ground segments individually, and then on the program as a whole, 
this review is to evaluate the completed detailed design of the element and subsystem products in 
sufficient detail to provide approval for a production stage. 
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Review 

Description 

Mission Operations Review 

Performed programwide, this review is to establish the adequacy of plans and schedules for 
ground systems and flight operations preparation, and to justify readiness to proceed with 
implementation of the remaining required activities, it is typically held subsequent to completion of 
detail design and fabrication activity, but prior to initiation of major integration activities of flight or 
ground-system elements. 

System integration Review 

Performed programwide, this review is to evaluate the readiness of the project to start system 
assembly, test, and launch operations. The objectives of the review include ensuring that planning 
is adequate for all remaining system activities and that available cost and schedule resources 
support completion of all necessary remaining activities with adequate margin. 

Flight Operations Review 

This review is to present the results of mission operations activities and show that the program has 
verified compliance with all requirements and demonstrated the ability to execute all phases and 
modes of mission operations, data processing, and analysis. 

Operational Readiness Review 

This review is to examine characteristics and procedures used in the system's operation and 
ensures that all system and support hardware, software, personnel, and procedures are ready for 
operations and that user documentation accurately reflects the deployed state of the system. It is 
typically held near the completion of pre-launch testing between the flight segment and the ground 
system. 

Source: GAO analysis of NOAA documentation. 


The GOES-R program has completed final design and begun building 
components of the flight and ground systems. Specifically, the program 
completed critical design reviews for the flight and ground projects and for 
the overall program between April and November 2012. In its evaluation 
of the program as part of the critical design review, an independent 
review board complimented the program on several recent achievements, 
stating that the program was beyond the level of maturity expected at that 
phase, and that the program’s planning was a major factor in the launch 
date of the first satellite remaining October 2015. 

As the spacecraft and instruments are developed, NASA conducts 
several interim reviews and tests before proceeding to the next major 
program-level review, the system integration review. These include a pre- 
environmental review, which represents the conclusion of an initial round 
of testing before exposing the instrument to testing under adverse 
environmental conditions; environmental testing of key functions under 
adverse conditions; and a pre-shipment review, which is conducted on 
each instrument to ensure it is ready to be shipped for integration and 
testing on the spacecraft. 

The GOES-R flight components are in various stages leading up to the 
system integration review. Of the six GOES-R instruments, one has 
completed environmental testing and its pre-shipment review; four 
instruments are in the midst of these reviews and tests; and one 
instrument has not yet passed its pre-environmental review. In addition, 
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the program began building the spacecraft in February 2013. Table 6 
provides more information on progress made on the key flight project 
components. 


Table 6: Development Status of Flight Project Components for the Geostationary Operational Environmental Sateliite-R 
Satellite, as of August 2013 


Key component Recent progress 


Advanced Baseline Imager 

• 

Pre-environmentai review completed in November 2012 

Environmental testing completed 


Extreme Ultraviolet/X-Ray Irradiance 


Instrument fully assembled and tested 


Sensor 


Pre-environmental review conducted in July 2012 

Pre-ship review conducted in April 2013 


Geostationary Lightning Mapper 


Assembly of some subcomponents completed, others continuing 

Subcomponent testing is under way 


Magnetometer 


Selected components have completed readiness reviews and tests 

Environmental testing is under way 


Solar Ultraviolet Imager 


Pre-environmental review completed in November 2012 

Environmental testing is under way 

Pre-ship review scheduled for October 2013 


Space Environmental In-Situ Suite 


Individual component testing completed 

Pre-environmental review conducted in May 2013 


Spacecraft 


Core structure testing completed; multiple components delivered 

Integration of subsystems under way 

Construction of the system module that will host instruments is under way 



Source; GAO analysis of NOAA documentation. 


Similar to the flight project, major ground system milestones are focused 
on building and testing components and the program has made progress 
in this area. Specifically, on the core ground system, a prototype for the 
operations module was delivered in late 2012 and used for initial testing 
and training. 10 In July 2013, the ground project delivered the iteration of 
the operations module that will be used to support the first satellite. In 
addition, the program has installed antenna dishes at NOAA’s primary 
satellite communications site, and completed two key reviews of antennas 
at the GOES remote backup site. The Product Distribution and Access 
System recently completed a review that will allow testing to begin on its 
first release. An integration review for ground components is also 


10 This module is called the Mission Management function. 
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expected to take place in January 2014. More detail on the progress of 
the ground project can be seen in table 7. 


Table 7: Development Status of the Geostationary Operational Environmental Satel!ite-R Series Ground Project Components, 
as of August 2013 


Key component 

Recent progress 

Core Ground Segment 

. Critical design review completed in April 201 2 

• Completed readiness review for receipt of GOES-R antennas 

* Delivery and installation of a prototype of the mission operations module completed; next iteration of 
the module delivered in July 2013 

Antenna System 

• Contractor demonstrated ability to produce 8 of 13 components; remainder due by the end of 2013 

• Installation of the first two antenna structures has been completed; the third antenna structure is 
scheduled to be completed in fiscal year 2014 

• Supporting infrastructure built, and two key reviews completed, for remote back-up antenna site 

Product Distribution and 
Access System 

. Testing begun on first increment/release 


Source. GAO analysis of NOAA documentation 


The program’s next major milestone is a programwide system integration 
review, which is scheduled for March 2014. Based on the results of that 
review, NOAA and NASA will decide whether to move the program to the 
next phase: the system assembly, integration and test, and launch and 
checkout phase. 


Contingency Reserves Are 
Generally in Line with 
Goals for Overall Program 
Development; Reporting 
on Reserve Values 
Remains Limited 


The GOES-R program is estimated to cost $10.9 billion. As of February 
2013, the program estimated that this amount was divided into four 
categories, with $6.0 billion for the flight project, $1.7 billion for the ground 
project, $2.0 billion for other program costs (including, among other 
things, program/project support and formulation) and $1.2 billion for 
operations and support. Program officials reported that the program is 
currently operating without cost overruns on any of its main components, 
but noted that the program life cycle costs may increase by $150 to $300 
million if full funding in the current fiscal year is not received. 


A portion of the amounts planned for the flight project and ground project 
are allocated to contingency reserves (also called management reserve). 
The program also keeps a programwide contingency allocation separate 
from those of the flight and ground projects. A contingency reserve 
provides program managers ready access to funding in order to resolve 
problems as they occur and may be necessary to cover increased costs 
resulting from unexpected design complexity, incomplete requirements, or 
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other uncertainties. 11 NASA's Goddard Space Flight Center requires its 
flight projects, including GOES-R, to maintain contingency reserves 
during system development, at a level of 25 percent of development 
costs. 12 The GOES-R program requires its flight and ground projects to 
maintain 20 percent of planned remaining development costs as reserve 
funding. 13 The program office also maintains contingency reserves equal 
to 10 percent of planned remaining development costs to cover program 
support costs and to supplement the flight and ground projects’ reserves 
if necessary. According to a NOAA program official, the GOES-R program 
is able to meet NASA's requirement through the combination of the 20 
percent flight and ground project requirements and the supplemental 10 
percent program-level reserve. An official also stated that the method of 
keeping separate reserves at the program and project levels was chosen 
as it was successful on past projects. 

The GOES-R flight project, ground project, and program office are at or 
above the amount of reserves they are required to carry. Specifically, as 
of March 2013, the overall contingency reserve percentages for the flight 
and ground projects were at 20 and 28 percent, respectively, which are at 
or above the required level of 20 percent. The program reserves were at 
11 percent, slightly above the required level of 10 percent. Reserve 
values and percentages are provided in table 8. 


1 1 GAO, GAO Cost Estimating and Assessment Guide: Best Practices for Developing and 
Managing Capital Program Costs, GAO-09-3SP (Washington, D.C.; Mar. 2009). 

12 While NOAA has ultimate responsibility for GOES-R, NOAA shares program 
management responsibilities with NASA, and the program office is located at NASA's 
Goddard Space Flight Center. 

13 Until late 2012, NOAA required the ground project to maintain 30 percent of its 
development cost as a reserve. However, program officials recently revised the 
requirement down to 20 percent to reflect the shorter amount of development time before 
launch and the retirement of some risks. 
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Table 8: Reserve Levels for the Geostationary Operational Environmental Sateilite- 
R Series Program, as of March 2013 

Component 

Required reserve 

Remaining reserve 

Flight 

20% 

20% 

Ground 

20% 

28% 

Program 

10% 

11% 

Total 

25% 8 

29% 


Source: NOAA data and GAO analysis of NOAA data 

Notes: 

"NASA and NOAA officials stated that the allocation of reserves among flight, ground, and program 
components meets NASA’s requirement of 25 percent because the program category includes 
reserve funds that can be used to supplement the flight and ground components. 
b A series of adjustments are made to the flight, ground, and program budget amounts before the 
reserve percentage is calculated; thus the reserve percentage cannot be reached by dividing 
contingency reserves by total budget authority. 

We previously reported that, in order to oversee GOES-R contingency 
funding, senior managers should have insight into the amount of reserves 
set aside for each satellite in the program and detailed information on 
how reserves are being used on both the flight and ground components. 
While the GOES-R program continues to regularly report on contingency 
funds, it does not report key information on the status of its reserve 
funding to senior level management. 14 

At monthly program management council meetings, the program reports 
summary information, such as the total value of contingency reserves and 
reserve percentage held for each fiscal year. Reserve totals are given for 
the flight and ground projects as well as for the program overall. However, 
the program does not report on the reserves needed for completing 
remaining development for each satellite in the series or provide detailed 
information on how reserves are being used. Thus, for example, if the 
later satellites in the series have a high level of reserves, they could mask 
low reserve values for earlier satellites in the series. Further, in its 
monthly presentations to senior managers and NOAA executives, the 
program does not include information on the cause of any changes in 
reserve values from the prior month or the assumptions it makes when 
calculating reserves. For example, the flight reserve value recently went 
up by 2 percentage points because the program decided to include 


14 GAO-12-576. 
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reserve funding for the GOES-T satellite in 2018, and the ground reserve 
values went down by 10 percentage points because the program shifted 
reserve funding from the ground to the flight projects. Neither of these 
changes was identified or explained in the monthly presentations. The 
lack of insight on how the reserves are calculated and modified could lead 
executives to misinterpret the size of the remaining reserves. Program 
officials noted that they took steps after our previous report to clarify what 
they report about reserves, but noted that the amount of information 
needed to fully explain reserve calculations and changes could be too 
much information for an executive-level briefing. Without regularly 
providing sufficiently detailed budget information, it may be more difficult 
for program management to have the information they need to make the 
best decisions possible regarding the program’s future funding. 


Recent and Potential 
Milestone Delays and 
Continued Weaknesses in 
Scheduling Practices 
Increase the Potential for a 
Delayed Launch 


The GOES-R program established programwide milestones, including the 
mission operations review and flight operations review, to determine the 
program’s ability to proceed to system integration and to complete 
mission operations, respectively. It also established five end-to-end 
system tests to validate compatibility between the space and ground 
segments before the launch of the first satellite. 

However, over the past year, the program delayed many of these key 
milestones and tests. Delays in the mission operations review means that 
the large-scale integration of flight and ground components will not occur 
until 21 months prior to launch. Similarly, delaying end-to-end tests until 
17 months prior to launch will allow the program less time to respond to 
any problems that occur. Table 9 highlights key milestones and the extent 
of recent delays. 
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Table 9: Delays in Milestones for the Geostationary Operational Environmental 
Sateliite-R Series Program 

Program milestone 

Date planned 
(as of Apr 201 2) 

Date completed 
or planned 
(as of Mar 2013) 

Delay 

Mission operations review 

January 2013 

January 2014 

12 months 3 

End-to-end test #1 

February 2014 

May 2014 

3 months 

End-to-end test #2 

May 2014 

August 2014 

3 months 

End-to-end test #3 

August 2014 

December 2014 

4 months 

Flight operations review 

September 2014 

January 2015 

4 months 

End-to-end test #4 

December 2014 

March 2015 

3 months 

End-to-end test #5 

July 2015 

July 2015 

No change 


Source: GAO analysis of NOAA data. 

“Program officials stated that they had erroneously scheduled the mission operations review too 
soon, and moved the date by 9 months to better reflect when the review was needed. Therefore, only 
3 of the 12 months were attributable to a delay. 

Continued Technical Issues The GOES-R program is also experiencing technical issues on the flight 

Could Cause Further Delays and 9 roun d projects that could cause further schedule delays. 

- The original supplier for a key component on the spacecraft moved to 
a different facility, introducing risk due to the loss of experienced 
personnel and the impact on schedule. This led the program to find an 
alternative supplier. While a design review was performed to confirm 
resolution of the issue in April 2013, this change may lead to a delay 
of up to 6 months in integrating the component on the spacecraft. 
Program officials noted that this delay is not expected to impact the 
program’s critical path or major milestones. 

. The Geostationary Lightning Mapper's electronics unit experienced 
problems during testing, which led the program office to delay the 
tests. 15 The program is considering several options to address this 
issue, including using the electronics unit being developed for a later 
GOES satellite to allow key components to proceed with testing. If the 
issue cannot be resolved, it would affect the instrument’s 
performance. As a result, the program is also considering excluding 


15 Under testing, the electronics board emitted unexpectedly high levels of radiation, which 
would cause a high number of false alarms and hinder the program's ability to assess the 
instrument's observations. 
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the Geostationary Lightning Mapper from the first GOES satellite. The 
program plans to make its decision on whether or not to include the 
instrument in late 2013. The removal of this instrument would cause a 
significant reduction in the satellite’s functionality. Key GOES users 
have stated that they would prefer that NOAA delay launching the 
GOES-R satellite rather than launch it without the Geostationary 
Lightning Mapper. 

• The program delayed the start of work on the ground system at the 
NOAA satellite operations facility by three months, from a planned 
date of October 2012 to January 2013, following a bid protest of the 
award of a contract to upgrade the facility. This delay compressed an 
already tight schedule for testing the ground system. 

• Testing for a number of ground system requirements has been 
postponed until future releases and builds, potentially causing 
modification to the schedule for these future products. 

• Power amplifiers for the antenna systems experienced higher than 
expected failure rates, which could lead to schedule delays and 
decreases in operational availability. 

Given that fewer than 3 years remain before GOES-R’s expected launch 
in October 2015, continued delays in key milestones and reviews 
decrease the likelihood that the launch date will be met. Program officials 
recently acknowledged that the GOES-R launch date may be delayed by 
about 6 months, and attributed the cause of the delay to a shortfall of $54 
million in anticipated funding in fiscal year 2013. 16 

Scheduling Practices Tmnrnvpd Delays in the program’s remaining schedule are also at risk of further 
but Weaknesses Remain ’ growth due to weaknesses in the program’s scheduling methods. 

Program schedules not only provide a road map for systematic program 
execution, but also provide the means by which to gauge progress, 
identify and address potential problems, and promote accountability. 
Achieving success in managing large-scale programs depends in part on 
having an integrated and reliable schedule that defines, among other 
things, when work activities and milestone events will occur, how long 


16 While our report was in final processing, NOAA announced that it would delay the 
launch date for its GOES-R satellite from October 2015 to the second quarter of fiscal 
year 2016. 
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they will take, and how they are related to one another. Without such a 
reliable schedule, program milestones may slip. 

In June 2012, we reported on weaknesses in program schedules that 
comprised portions of the program’s Integrated Master Schedule, 
including subordinate schedules for the spacecraft and core ground 
system. At that time, our work identified nine best practices associated 
with developing and maintaining a reliable schedule. 17 These are (1) 
capturing all activities, (2) sequencing ail activities, (3) assigning 
resources to all activities, (4) establishing the duration of all activities, (5) 
integrating schedule activities horizontally and vertically, (6) establishing 
the critical path for all activities, (7) identifying reasonable float time 
between activities, (8) conducting a schedule risk analysis, and (9) 
updating the schedule using logic and durations. See table 10 for a 
description of each of these best practices. 


17 See GAO-09-3SP. In May 2012, we published updated guidance on scheduling best 
practices. See GAO, Schedule Assessment Guide: Best Practices for Project Schedules — 
Exposure Draft, GAO-12-120G (Washington, D.C.: May 30, 2012). The updated guidance 
identifies 10 best practices. 
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Table 10: Description of Scheduling Best Practices 

Practice 

Description 

Capturing all activities 

The schedule should reflect all activities (steps, events, outcomes, etc.) as defined in the 
program’s work breakdown structure to indude activities to be performed by both the 
government and its contractors. 

Sequencing all activities 

The schedule should sequence activities in the order that they are to be implemented, in 
particular, activities that must finish prior to the start of other activities (i.e., predecessor 
activities), as well as activities that cannot begin until other activities have been completed 
(i.e., successor activities) should be identified. 

Assigning resources to ail activities 

The schedule should reflect who will do the work activities, whether all required resources will 
be available when they are needed, and whether there are any funding or time constraints. 

Establishing the duration of all 
activities 

The schedule should reflect the duration of each activity. These durations should be as short 
as possible and have specific start and end dates. 

Integrating schedule activities 
horizontally and vertically 

The schedule should be horizontally integrated, meaning that it should link the products and 
outcomes associated with sequenced activities. The schedule should also be vertically 
integrated, meaning that there is traceability among varying levels of activities and supporting 
tasks and subtasks. 

Establishing the critical path for all 
activities 

The critical path represents the chain of dependent activities with the longest total duration in 
the schedule. 

Identifying reasonable float time 
between activities 

The schedule should identify a reasonable amount of float— the time that an activity can slip 
before the delay affects the finish milestone— so that schedule flexibility can be determined. 

As a general rule, activities along the critical path typically have the least amount of float. 

Conducting a schedule risk analysis 

A schedule risk analysis is used to predict the level of confidence in the schedule, determine 
the amount of time contingency needed, and identify high-priority schedule risks. 

Updating the schedule using logic and 
durations to determine the dates 

The schedule should use logic and durations in order to reflect realistic start and completion 
dates, be continually monitored to determine differences between forecasted completion 
dates and planned dates, and avoid logic overrides and artificial constraint dates. 


Source: GAO analysis of government and industry practices in GAO-09-3SP 


In a previous report, we observed that important schedule components in 
GOES-R related schedules had not been included or completed, and 
recommended that these shortfalls be addressed. 18 NOAA has since 
improved selected practices on its spacecraft and core ground schedules, 
but other practices stayed the same or worsened. Specifically, for the 
spacecraft, 2 practices were improved, 5 stayed the same, and 2 became 
weaker. For the core ground system, 4 practices were improved, 3 stayed 
the same, and 2 became weaker. Table 1 1 compares our assessments of 
the spacecraft and core ground system schedules in July 2011 and 
November 2012. 


18 GAO-t 2-576. 
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Table 1 1 : Assessment of Selected Schedules Use of Best Practices over Time 



Spacecraft schedules 

Core ground schedules j 

Scheduling best practice 

July 2011 

November 2012 ; 

July 2011 

November 2012 

Best practice 1: Capturing all activities 

3 

• 

3 

3 

Best practice 2: Sequencing all activities 

3 

3 

3 

3 

Best practice 3: Assigning resources to all activities 

(5 

3 

3 

0 

Best practice 4: Establishing the duration of all activities 

3 

3 

3 

3 

Best practice 5: Integrating schedule activities horizontally and 
vertically 

3 

3 

3 

0 

Best practice 6: Establishing the critical path for all activities 

3 

• 

(3 

3 

Best practice 7 : Identifying float on activities and paths 

3 

3 

0 

0 

Best practice 8: Conducting a schedule risk analysis 

<5 

<5 

0 

3 

Best practice 9: Updating the schedule using logic and 
durations to determine the dates 

• 

3 

3 

• 


Source: GAO analysis of schedules provided by GOES-R. documents and information received from GOES-R officials. 

Key 

• The agency/contractor has fully met the criteria for this best practice 
« The agency/contractor has substantially met the criteria for this best practice 
« The agency/contractor has partially met the criteria for this best practice 
» The agency/contractor has minimally met the criteria for this best practice 
o The agency/contractor has not met the criteria for this best practice 


NOAA has improved elements of the schedules for both components. 
Specifically, the spacecraft schedule has eliminated level of effort 
activities 19 and has assigned resources for a greater percentage of 
activities. The core ground schedule now has an automated process by 
which all subcontractor records are combined to create an integrated 
schedule. It has a series of connected activities that lead to what 
contractor officials consider its main milestone delivery, and has 
implemented a detailed schedule risk analysis for a key upcoming 
release. 

However, scheduling issues remain on the schedules for both 
components. For example, both schedules have issues with sequencing 


19 Levei-of-effort activities represent work that has no measurable output and cannot be 
associated with a physical product or defined deliverable. These activities are typically 
related to management and other oversight that continues until the detailed activities they 
support have been completed. 
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remaining activities and integration between activities. Regarding the 
spacecraft schedule, there is a small subset of activities with incomplete 
links between activities, and more than 20 percent of remaining detail 
activities have lags, or a set number of days between an activity and its 
successor. In the core ground schedule, a number of activities are 
missing either predecessor or successor activities, and there are several 
activities representing the end of the project on or about the same date. 
Without the right linkages, activities that slip early in the schedule do not 
transmit delays to activities that should depend on them. When this 
happens, the schedule will not provide a sufficient basis for understanding 
the program as a whole, and users of the schedule will lack confidence in 
the dates and the critical path. 

Both schedules also have a very high average of total float time for 
detailed activities. 20 Specifically, total float time is greater than two months 
for nearly two-thirds of remaining detailed activities in the spacecraft 
schedule, and at least a year for more than 10 percent of remaining detail 
activities in the core ground schedule. In the case of spacecraft, officials 
stated that high levels of float time were often due to activities that had 
been completed at one time for several satellites, only one of which was 
immediately needed. Officials also provided detailed information on the 
activities with the highest amount of float. In the case of the core ground 
schedule, officials stated that many activities occurring after the main 
milestone date, which occurs nearly five years prior to the end of the 
schedule, do not have a true successor, and therefore are calculated only 
to the end of the contract. Officials also stated that values and trends in 
float time are monitored regularly for both schedules. Such high values of 
total float time can falsely depict true project status, making it difficult to 
determine which activities drive key milestone dates. Without reasonable 
values of total float time, it cannot be used to identify activities that could 
be permitted to slip and thus release and reallocate resources to activities 
that require more resources to be completed on time. 

In addition, the project’s critical path does not match up with activities that 
make up the driving path 21 on the core ground schedule. Contractors 


20 Total float time is the amount of time an activity can be delayed or extended before the 
delay affects its successors or the program's finish date. 

21 A driving path is the longest path of successive activities that drives the finish date for a 
key milestone. The driving path often corresponds to a schedule’s critical path. 
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monitor a driving path monthly to both major and minor milestone 
deliveries. However, until the schedule can produce a true critical path, it 
will be more difficult for the program office to provide reliable time line 
estimates or identify when problems or changes may occur and their 
effect on downstream work. Also, without a valid critical path to the end of 
the schedule, management cannot focus on activities that will have a 
detrimental effect on the key project milestones and deliveries if they slip. 

Further, neither schedule file has fully integrated resources with schedule 
activities. As of November 2012, contractor officials stated that the ground 
system schedule was not feasible given available resources and that they 
were in the process of revising their immediate schedules to make them 
feasible. The spacecraft schedule contains major resource categories that 
correspond to contractor sites and work phases. However, thresholds for 
overruns of resource allocations are functionally disabled within the 
schedules through the setting of an arbitrarily high value for maximum 
resources per category. In response, contractor officials stated that 
account managers are responsible for monitoring resource levels and that 
weekly meetings are held to ensure that resource issues are discussed. 
Information on resource needs and availability in each work period assists 
the program office in forecasting the likelihood that activities will be 
completed as scheduled. If the current schedule does not allow insight 
into current or project allocation of resources, then the risk of delays in 
the program’s schedule is significantly increased. 

Deficiencies in scheduling practices such as the ones outlined here could 
increase the likelihood of launch date delays, because decision making 
would be based on data that does not accurately depict current status, 
thus impeding management’s ability to conduct meaningful oversight on 
the program's schedules. Program officials noted that they have made 
improvements in scheduling practices, but explained that because the 
schedules are so dynamic there are always areas for improvement. Lack 
of the proper understanding of current program status due to schedules 
that are not fully reliable undercuts the ability of the program office to 
manage a high-risk program like GOES-R. 


Delays in the GOES-R 
Launch Date Could 
Increase the Risk of a 
Satellite Data Gap 


Potential delays in the launch date of the first GOES-R satellite would 
increase the risk of a gap in GOES satellite coverage. NOAA’s policy is to 
have two operational satellites and one backup satellite in orbit at all 
times. This policy proved useful in December 2008 and again in 
September 2012, when the agency experienced problems with one of its 
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operationai satellites, but was able to move its backup satellite into place 
until the problems had been resolved. 

NOAA is facing a period of at least a year when it will not have a backup 
satellite in orbit. Specifically, in April 2015, NOAA expects to retire one of 
its operational satellites (GOES-13) and move its backup satellite (GOES- 
14) into operation. Thus, the agency will have only two operational 
satellites in orbit — and no backup satellite — until GOES-R is launched 
and completes an estimated 6-month post-launch test period. If GOES-R 
is launched in October 2015, the soonest it could be available for 
operational use would be April 2016. Any delay to the GOES-R launch 
would extend the time without a backup to more than one year. Figure 5 
shows anticipated operational and test periods for the two most recent 
series of GOES satellites. 


Figure 5: Potential Gap in Geostationary Operational Environmental Satellite 
Coverage 



Source: GAO analysis ol NOAA data. 


In addition to the year or more during which no back-up satellite would be 
available, there is a chance that NOAA would have to operate with a 
single operational satellite. In December 2012, an independent review 
board estimated that there is a 36 percent chance that the GOES 
constellation would have only one operational satellite at the expected 
date of GOES-R’s launch. Thus, if NOAA were to experience a problem 
with either of its operationai satellites before GOES-R is in orbit and 
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operational, it would need to rely on older satellites that are beyond their 
expected operational lives and may not be fully functional. Without a full 
complement of operational GOES satellites, the nation’s ability to 
maintain the continuity of data required for effective weather forecasting 
could be compromised. This, in turn, could put the public, property, and 
the economy at risk. 


System requirements describe the functionality needed to meet user 
needs and perform as intended in an operational environment. According 
to leading industry, academic, and government entities, a disciplined 
process for developing and managing requirements can help reduce the 
risks of developing or acquiring a system. 22 One key aspect of effective 
requirements management involves managing changes to requirements 
through a standardized process. Table 12 outlines best practices of a 
sound change management process and key questions for evaluating the 
process. 


Table 12: Best Practices in Managing Requirements Changes 
Practice Key questions 

Manage changes to Does the program (or project) have a requirements management plan? 

requirements throughout the life Does the program maintain a current and approved set of requirements? 
cycle using a standard process Does p r0 g ram have an approved set of baseline requirements? 

Does the program's change management process provide guidance for the identification, review, 
and management of all requirements changes? 

Do change management processes apply throughout the program’s life cycle? 

Does change management documentation, such as meeting notes or change records, indicate that 
the organization is following its change management policies and procedures? 

Document changes to Does the organization maintain records for all changes? 

requirements Are all approved requirements changes documented according to a standard process? 

Are other work products in consistent alignment with requirements changes? 


NOAA Has a Process 
for Managing Changes 
in GOES-R 
Requirements, but 
Changes Could Affect 
Some Users 


22 Leading industry and governments sources— including the Software Engineering 
Institute’s Capability Maturity Model®-lntegration, the Project Management Institute's 
Project Management Body of Knowledge, the Federal Information Security Controls Audit 
Manual, the IT Governance Institute’s Control Objectives for Information and related 
Technology governance framework, and NASA system development policies — provide 
extensive guidance on managing requirements. 
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Practice 

Key questions 

Document rationale for change 
and analyze impact 

Does the program document rationales for proposed changes? 

Does the program maintain a history of these rationales? 

Do they analyze the impact of a proposed change to the project and to users in impact 
assessments? 

Do these assessments address impacts to cost, schedule, risk, and project capabilities? 

Have an approval body with 
appropriate representation 
review and approve all 
requirements changes 

Has the program established an approval body for requirements changes and defined its 
responsibilities? 

Do change management policies require appropriate representation on the approval body? 

Do change management policies require that the approval body review and approve all changes? 
Does documentation show that the approval body reviewed and approved program requirements 
changes? 

Ensure that requirements 
changes are aligned with user 
needs 

Are requirements analyzed according to a standard process to determine if they continue to meet 
user needs? 

Do impact assessments show that the requirements remain in alignment with user needs? 

Has the program traced the changed requirements back to user needs? 

Has the program verified and validated that changed requirements align with user needs? 

Communicate requirements 
changes to users 

When requirements changes occur, are they communicated to end users? 

Is change information disseminated as part of a standard process? 


Source: GAO analysis of government and industry practices. 


The GOES-R program has a change management process that satisfied 
three practices, partially satisfied two practices, and did not satisfy one 
practice. Specifically, GOES-R has established a change management 
process that tracks and documents changes in requirements, documents 
the rationale for the changes as well as the potential impact of the change 
on cost and schedule, and ensures that changes are reviewed and 
approved by a change control board. In addition, the program has 
evaluated the impact of key changes on selected users and 
communicated with those users. However, as we first reported in 2010, 
the program is still weak in evaluating the impact of changes on external 
users who rely on GOES data products and in effectively communicating 
changes to those satellite data users. 23 Specifically, table 13 outlines how 
the GOES-R program performed on each of the best practices for 
managing changes in requirements, and is followed by a more detailed 
discussion of key shortfalls. 


23 GAO-1 0-799. 
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Table 13: Assessment of Geostationary Operational Environmental Satellite-R Series Program Practices in Managing 

Changes in Requirements 

Practice 

Assessment 

Discussion 

Manage changes to 
requirements 
throughout the life 
cycle using a standard 
process 

Satisfied 

The GOES-R program has a requirements management plan and has established a 
change management process to apply throughout the project's life cycle. In order to 
change a high-level requirement, the program must follow a detailed process that begins 
with proposing a change request, evaluating it, and obtaining approval or rejection of the 
request. The program also maintains an approved set of high-level baseline requirements 
and updates them regularly in response to requirements changes. 

Document changes to 
requirements 

Satisfied 

The GOES-R program documents requirements changes in a public change log associated 
with its high-level requirements document. More detailed information on the changes is 
tracked in an internal database. The changes documented in the change log align with 
those documented in the internal tracking database. 

Document rationale for 
change and analyze 
impact 

Partially 

satisfied 

The GOES-R program documented the rationale for individual requirements changes as 
well as the cost and schedule impact of selected changes. In addition, the program has 
assessed the impact of key changes on selected users within NOAA. However, the 
program has not assessed the cost and schedule impact of all changes, and has not 
assessed the impact of key changes on external users who rely on GOES satellite data. 
Program officials noted that they assessed the cost and schedule impact of changes that 
were expected to negatively impact the program's cost or schedule, and that they focus 
their impact assessments on users within NOAA because they are considered the primary 
users. 

Have an approval body 
with appropriate 
representation review 
and approve all 
changes 

Satisfied 

The GOES-R program has a configuration change board with representation from key 

NOAA and NASA officials. The board’s responsibilities are formalized in program 
documentation. Further, the board members review and approve requirements changes. 

Ensure that 
requirements changes 
are aligned with user 
needs 

Not 

satisfied 

The program’s change management process does not require taking steps to ensure that 
changes in requirements are aligned with user needs. Specifically, the process does not 
require officials to trace applicable changes to user needs or to test or simulate whether the 
change still meets user needs. Moreover, for seven selected changes we reviewed, the 
program did not demonstrate the steps it took to test or validate the changes to ensure 
they were aligned with user needs Program officials noted that they utilize a user working 
group to communicate changes to users and elevate concerns raised by users. 

Communicate 
requirements changes 
to users 

Partially 

satisfied 

The GOES-R program generally communicates requirements changes to key users within 
NOAA and NOAA’s National Weather Service through mechanisms such as e-mail 
correspondence and working groups, while it communicates changes to external users 
through periodic conferences, such as the GOES users’ conferences. However, it does not 
alert external users who rely on GOES data to perform their missions about specific 
changes in requirements that will likely affect their operations. These external users include 
the Federal Aviation Administration, the U.S. Department of Agriculture, and the 

Department of the Navy. Officials at all three agencies reported that they were not informed 
about key changes in requirements that could affect their operations. Program officials 
stated that they work through a variety of working groups to try to communicate changes 
with those who utilize the satellite data. 


Source; GAO analysis of NOAA documentation. 
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While the program generally communicates requirements changes to key 
users within NOAA’s National Weather Service community, it does not 
communicate as well with satellite data users external to NOAA. Many 
such users are dependent on GOES satellite data for their respective 
missions. Officials responsible for working with satellite weather 
observations at three agencies were unaware of selected changes in 
GOES-R requirements. For example, the Federal Aviation Administration 
uses the satellites’ data and images to manage air traffic across the 
country, and the Navy uses the data for oceanic weather forecasting, as 
well as tactical ocean analysis of regions of interest. They stated that 
NOAA had not reached out to them to alert them to these changes or ask 
if the changes would impact them. Similarly, Forest Service officials were 
concerned that potential changes in spectrum allocations could affect 
their ability to obtain data from their own ground-based weather 
observation systems because they currently rely on GOES-R 
communication channels to obtain this data. 

GOES-R program officials noted that they provide regular briefings to the 
Office of the Federal Coordinator for Meteorology, an interagency council 
with membership from fifteen federal departments and agencies involved 
in meteorological activities (including the Departments of Agriculture, 
Defense, and Transportation) and that the Air Force represents the 
Department of Defense community on the GOES-R Series Independent 
Advisory Committee. However, they acknowledged that they cannot 
ensure that the information they provide is disseminated within the 
agencies. Further, GOES officials explained that one reason for the 
distinction between the internal and external users is that the internal 
users belong to formal working groups and receive regular updates from 
the GOES-R program, while the other users generally have more informal 
or indirect connections with the program. Instead of direct 
communications such as e-mails, the other users may receive information 
about GOES-R requirements changes from publically available 
information or through other meteorological partnerships with NOAA. 
Without consistent and direct communication, users may be unaware of 
changes to program requirements that are critical to their respective 
missions. Because GOES-R users across the country have missions that 
preserve and protect property and life, it is critical that these organizations 
are made aware of any changes as soon as they are made, so that they 
can assess and mitigate any significant impacts. 
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GOES-R Program Has 
Undergone Multiple Changes in 
Requirements; Selected 
Changes Could Affect User 
Operations 


Since 2007, NOAA has changed multiple system requirements on the 
GOES-R program. These changes involved strengthening or relaxing 
specifications on selected products, finalizing a decision not to develop 31 
products, and modifying programmatic requirements not tied to any 
individual product. For example, NOAA strengthened specifications for 
the geographic coverage, image resolution, and refresh rate on a product 
depicting total precipitable water, and strengthened accuracy 
specifications for a product depicting cloud layers and heights. NOAA 
also relaxed specifications to provide less measurement accuracy on a 
product depicting hurricane intensity, less geographic coverage on a 
product depicting sea surface temperatures, less resolution on a product 
that tracks the motion of clouds through the atmosphere, and less timely 
updates on a product depicting lightning detection. The GOES-R program 
also documented NOAA's earlier decision not to develop or provide 31 
products that it labeled as optional, noting that the products will only be 
developed if funding becomes available. In addition, programmatic 
changes include the elimination of 97 percent mission availability as a 
measure of minimum performance success and the decision not to 
transmit raw satellite data to users. Table 14 provides an overview of key 
changes in product and program requirements since 2007. 


Table 14: Summary of Key Changes in Product and Program Requirements between 2007 and 2012 

Type of 
Change 

November 2007 

October 2012 

Product 

34 products, each with specifications for accuracy, 
geographic coverage, resolution, and timeliness 

34 products, of which: 

20 (59%) were modified 
. 14 had changes in accuracy measurement 

• 7 had changes in geographic coverage 

* 3 had changes in horizontal resolution 

. 8 had changes in refresh rate/latency 


34 optional products 

2 optional products were eliminated 

1 optional product was combined with another optional 
product 

31 optional products are not being developed 

Program 

The satellites shall be capable of being configured to 
accommodate additional instrumentation with minimal 
redesign of the spacecraft. 

Requirement removed 


The GOES-R series is required to meet or exceed the 
level of capability of the prior series of satellites (GOES- 
N.O.P) for system continuity. 

Requirement removed 


The GOES-R satellites are required to acquire and 
transmit the raw environmental data to ground stations 
to allow for the timely and accurate processing of data. 

While the program is still required to relay GOES-R sensor 
data, the requirement to acquire and transmit raw data has 
been removed. 
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Type of 

Change November 2007 October 2012 


GOES-R is required to meet or exceed the prior series The program is required to make products available to 
of satellites’ capabilities for storage of environmental NOAA Archival Data Centers, but capabilities for storing the 
data. data are not specified. 


The GOES-R system need date is specified as 
December 2014. 

Requirement removed 

GOES-R is required to achieve “full operational 
capability,” which is defined, in part, as full coverage of 
the east and west positions. 

The requirement for full operational capability was 
strengthened to include the production and availability of the 
toll product set of satellite data to users. 

Minimum performance success is defined as 97 percent 
mission availability for collecting, generating, and 
distributing key products over a defined central 
coverage zone. 

Minimum performance success is redefined as the 
successful generation and availability of key functions to 
users. The availability percentage has been removed. 

The operational lifetime of the GOES-R series shall 
extend through 2028. 

The individual GOES-R satellites’ lifetimes shall be 5 years 
in on-orbit storage plus 10 years in operation. 

Requirements for a remote backup facility not specified 

Addition of requirements for a remote backup facility 

Failover time to backup satellite or backup ground 
facility not mentioned 

This information is now included. 

Requirements do not specify the locations of the 
satellites in on-orbit storage 

Added requirements that specify the satellites’ checkout 
location and the location of on-orbit satellite storage 


Source: GAO analysis of NOAA sJocumenialion. 


While NOAA officials stated that they believe that only one of the changes 
that were made since 2007 was significant, 24 internal and external users 
noted that they found many of the changes to be significant, in addition, 
selected satellite data users noted concern at the loss of 17 of the 
optional products that are no longer being developed. The changes that 
users found significant, along with user reasoning for why these changes 
are significant, are listed in table 15. GOES-R program officials 
acknowledged that the National Weather Service and other users will 
have impacts from the loss or degradation of products, but that it is not 
always accurate to assume that GOES-R could have met the original 
requirements. In 2011, an algorithm development executive board 
reported that several original requirements could not have been met 
because, among other reasons, they relied on a hyperspectra! instrument 
that was removed from the program, the requirements were poorly stated 
and it only became evident later that GOES could not support them, and 


24 NOAA officials stated that the sole significant change was a reduction in the accuracy 
requirement for the magnetometer, and demonstrated that they had obtained approval 
from the most pertinent user community, the National Weather Sen/ice's Space Weather 
Prediction Center, before making the change. 
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there were scientific limitations on the development of the products that 
only became evident after development had started. Program officials 
stated that they have identified alternative methods for obtaining certain 
products (some outside the scope of GOES-R) and that they are 
proactively trying to develop alternative products in coordination with 
users and other development organizations. 


Table 15: User Concerns about Key Changes or Deviations in Requirements 

Product 

Change 

User concerns 

Cloud top height 

Relaxation of accuracy 
requirements 

Navy officials reported that this change will likely cause significant errors, which will 
reduce the utility of the cloud top height measurements. 

Downward 

shortwave 

radiation 

Relaxation of accuracy 
requirements 

Navy officials reported that the larger accuracy ranges might make this product difficult 
to use in a statistically significant way. 

Reflected 

shortwave 

radiation 

Relaxation of accuracy 
requirements 

Navy officials reported that the larger accuracy ranges might make this product difficult 
to use in a statistically significant way. 

Derived stability 
indices 

Relaxation of resolution 
requirements 

Officials from both the Navy and the Federal Aviation Administration expressed 
concern about this change. The Federal Aviation Administration reported that the 
reduction in horizontal resolution might result in reduced forecast accuracy and a 
reduced ability to verify convection, which is useful for predicting severe storms. 

Lightning 

detection 

Reduction in product 
timeliness 

Officials from the Federal Aviation Administration expressed concern about this 
change. They reported that a delay in refresh times could be significant for aviation 
operations, especially over water areas that rely on satellite data for coverage. In 
these areas, lightning will be used as an indicator of storm formation and delays in 
detection and transmission could impact situational awareness. 

Magnetometer 

(geomagnetic 

field) 

Reduction of magnetic 
field accuracy 
requirements 

The National Weather Service’s Space Weather Prediction Center found this change 
acceptable for the purposes of GOES-R data, but determined that the reduction of the 
accuracy requirements would noticeably increase error in the instrument's readings of 
solar energy and the geomagnetic field. 

Aerosol particle 
size 

An optional product; not 
planned to be developed 
or provided. 

Officials from the Department of Agriculture's Forest Service and the Navy expressed 
concern about not receiving this product. The Forest Service reported that this product 
would help them monitor and manage air quality. 

Aircraft icing 
threat 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service's Aviation Weather Center, the Navy, and 
the Federal Aviation Administration expressed concern about not receiving this 
product. The Aviation Weather Center reported that this product would be useful 
because icing is a major hazard for safe air travel. 

Cloud layers / 
heights 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service's Aviation Weather Center and the Navy 
expressed concern about not receiving this product. The Aviation Weather Center 
reported that this product would help prevent aviation accidents caused by low 
visibility. Low cloud ceiling and visibility was associated with about 20 percent of all 
aviation accidents from 1994 to 2003. 

Cloud liquid water An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service’s Aviation Weather Center and the Navy 
expressed concern about not receiving this product. The Aviation Weather Center 
reported that this product might help identify regions with low visibility. Because iow 
visibility is associated with airline accidents, this product would help prevent aviation 
accidents. 
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Product 

Change 

User concerns 

Cloud type 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service's Aviation Weather Center, the Navy, and 
the Federal Aviation Administration expressed concern about not receiving this 
product. The Aviation Weather Center reported that, as it is related to the icing threat, 
this product would help air traffic controllers Know if a cloud was made of ice, water, or 
a mixture of the two. 

Convective 

initiation 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service’s Aviation Weather Center expressed 
concern about not receiving this product because new convection is critical to air traffic 
flow management, and convection is a major hazard for safe and efficient flight. In 
addition, officials from the Navy, the Federal Aviation Administration, and the 

Department of Agriculture’s Forest Service were concerned by the loss of this product. 
The Forest Service officials reported that the loss of this product could impact its ability 
to locate potential ignition areas for wildland fires. The National Weather Service’s 

Storm Prediction Center also stated that this product was likely to have had a positive 
impact on its mission, which is to predict and monitor high impact weather events such 
as tornadoes. 

Enhanced "V7 
overshooting top 
detection 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service’s Aviation Weather Center, the Navy, and 
the Federal Aviation Administration expressed concern about not receiving this 
product. The Aviation Weather Center reported that this product would indicate the 
location of turbulence and convection, thereby helping to improve the safety and 
efficiency of air travel. The National Weather Service's Storm Prediction Center also 
stated that this product was likely to have had a positive impact on its mission. 

Flood/standing 

water 

An optional product; not 
planned to be developed 
or provided. 

Officials from the Department of Agriculture’s Forest Service and the Navy expressed 
concern about not receiving this product. Forest Service officials are concerned that 
the removal of this product would impact their management of and response to 
hazards and disasters. 

Ice cover 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service’s Environmental Modeling Center and the 
Navy expressed concern about not receiving this product. The Environmental 

Modeling Center reported that ice cover data would help assimilate data received from 
the sounding sensors. 

Low cloud and 
fog 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service's Aviation Weather Center, the Navy, and 
the Federal Aviation Administration expressed concern about not receiving this 
product. The Aviation Weather Center reported that this product would help prevent 
aviation accidents caused by iow visibility. Low ceiling and visibility accounted for 
about 20 percent of ail aviation accidents from 1994 to 2003. 

Ozone total 

An optional product; not 
planned to be developed 
or provided. 

Officials from the Department of Agriculture’s Forest Service are concerned that the 
removal of this product would impact its ability to monitor and manage air quality. 

Probability of 
rainfall 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service’s Aviation Weather Center, the Navy, and 
the Federal Aviation Administration expressed concern about not receiving this 
product. The Aviation Weather Center reported that the loss of this product is 
significant because heavy rainfall relates to air traffic planning and the efficiency of 
airport operations, and heavy rainfall is correlated with low ceiling and low visibility 
and/or convection. Officials from the Department of Agriculture were also concerned 
that the loss of this product would impact their predictive services. 
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Product 

Change 

User concerns 

Rainfall potential 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service’s Aviation Weather Center, the Navy, and 
the Federal Aviation Administration expressed concern about not receiving this 
product. The Aviation Weather Center reported that the loss of this product is 
significant because heavy rainfall relates to air traffic planning and the efficiency of 
airport operations, and heavy rainfall is correlated with low ceiling and low visibility 
and/or convection. Officials from the Department of Agriculture were also concerned 
that the loss of this product would impact their predictive services. 

Tropopause 
folding turbulence 
prediction 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service’s Aviation Weather Center, the Navy, and 
the Federal Aviation Administration expressed concern about not receiving this 
product. The Aviation Weather Center reported that the loss of this product is 
significant because turbulence is a major hazard for safe air travel. 

Vegetation 
fraction (green 
vegetation) 

An optional product; not 
planned to be developed 
or provided. 

Officials from the Department of Agriculture’s Forest Service are concerned by the loss 
of this product because it would help with forest health monitoring and fire danger 
assessments. Officials from the National Weather Service’s Environmental Modeling 
Center also expressed concern about not receiving this product because it would help 
them analyze and predict temperature differences and precipitation. 

Vegetation index 

An optional product; not 
planned to be developed 
or provided. 

Officials from the Department of Agriculture's Forest Service are concerned by the loss 
of this product because it would help with forest health monitoring and fire danger 
assessments. 

Visibility 

An optional product; not 
planned to be developed 
or provided. 

Officials from the National Weather Service's Aviation Weather Center, the Navy, the 
Federal Aviation Administration, and the Department of Agriculture's Forest Service 
expressed concern about the loss of this product. The Aviation Weather Center 
reported that this product would help prevent aviation accidents caused by low 
visibility, and the Forest Service reported that it would have helped with air quality 
monitoring and management. 


Source: GAO analysis ol federal agency responses. 


In addition to the changes that have already been implemented on the 
GOES-R program, there are other potential changes that could occur. For 
example, by the end of 2013, the program plans to decide whether or not 
to include the Geostationary Lightning Mapper on the GOES-R satellite. 
Also, there could be changes in the spectrum allocated to weather 
satellite data. Officials from the National Weather Service and Forest 
Service raised concerns that these potential changes could also affect 
their operations. Because these changes have the potential to impact 
satellite data user operations, it is critical that the GOES-R program 
communicates program changes to the extended user community. By 
doing so, satellite data users can establish plans to mitigate any shortfalls 
in data and minimize the impact of the changes on their operations. 
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NOAA Developed 
GOES-R Contingency 
Plans, but 

Weaknesses Increase 
the Impact of a 
Potential Coverage 
Gap 


GOES satellite data are considered a mission-essential function because 
of their criticality to weather observations and forecasts. These 
forecasts — such as those for severe storms, hurricanes, and tornadoes—: 
can have a substantial impact on our nation’s people, infrastructure, and 
economy. Consequently, NOAA policy requires that there must be two in- 
orbit GOES satellites and one on-orbit spare in operation at all times. If 
one of the operational satellites were to fail, the on-orbit spare could be 
moved into position to take the place of the failed satellite. However, if 
there are delays in the launch of the GOES-R satellite or if either of the 
two satellites currently in operation were to fail, NOAA would not have an 
on-orbit spare to fill the gap. 


Government and industry best practices call for the development of 
contingency plans to maintain an organization’s essential functions in the 
case of an adverse event. 25 These practices include key elements such 
as defining failure scenarios, identifying and selecting strategies to 
address failure scenarios, developing procedures to implement the 
selected strategies, identifying any actions needed to implement the 
strategies, testing the plans, and involving affected stakeholders. These 
elements can be grouped into categories, including (1) identifying failure 
scenarios and impacts, (2) developing contingency plans, and (3) 
validating and implementing contingency plans (see table 16). 


25 See GAO, Year 2000 Computing Crisis: Business Continuity and Contingency 
Planning , GAO/AiMD-IO.1.19 (Washington, D.C.: August 1998); National Institute of 
Standards and Technology, Contingency Planning Guide for Federal Information Systems, 
NIST 800-34 (Gaithersburg, Md.: May 2010); Software Engineering Institute, CMMI®for 
Acquisition, Version 1.3 (Pittsburgh, Pa.: November 2010). 
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Table 16: Guidelines for Developing a Sound Contingency Plan 

Category 

Key elements 

Identifying failure scenarios and 
impacts 

Define likely failure scenarios 

Conduct impact analyses showing impact of failure scenarios on business processes and user 
requirements 

Define minimum acceptable level of outputs and recovery time objectives, and establish 
resumption priorities 

Developing contingency plans 

Define roles and responsibilities for implementing contingency plans 

Identify alternative solutions to address failure scenarios 

Select contingency strategies from among alternatives based on costs, benefits, and impacts 
Develop “zero-day” procedures 

Define actions needed to implement contingency strategies 

Define and document triggers and time lines for enacting the actions needed to implement 
contingency plans 

Ensure that steps reflect priorities for resumption of products and recovery objectives 

Designated officials review and approve contingency plan 

Validating and implementing 
contingency plans 

Identify steps for testing contingency plans and conducting training exercises 

Prepare for and execute tests 

Execute applicable actions for implementation of contingency strategies 

Validate test results for consistency against minimum performance levels 

Communicate and coordinate with stakeholders to ensure that contingency strategies remain 
optimal for reducing potential impacts 

Update and maintain contingency plans as warranted 


Source GAO analysis o( guidance documents from the National Institute of Standards and Technology, Software Engineering Institute, 
GAO. NOAA, and the GOES-R program. 


NOAA has established contingency plans for both its GOES satellites and 
its associated ground systems. In September 2010, we recommended 
that NOAA develop and document continuity plans for the operation of 
geostationary satellites that include the implementation procedures, 
resources, staff roles, and timetables needed to transition to a single 
satellite, a foreign satellite, or other solution. In September 2011, the 
GOES-R program provided a draft plan documenting a strategy for 
conducting operations if there were only a single operational satellite. In 
December 2012, the program provided us with a final version of this plan. 

It included scenarios for three, two, and one operational satellites. In 
addition to this satellite contingency plan, NOAA has another 
contingency-related plan with activation procedures for its satellites. 


Furthermore, the NOAA office responsible for ground-based satellite 
operations and products has created plans for contingency operations at 
the GOES ground system facility, the Satellite Operations Control Center. 
Specifically, NOAA’s plans describe the transfer of critical functions to a 
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backup facility during an emergency. The continuity plan contains, among 
other things, descriptions of the alternate locations for resources, and the 
performance of key functions and implementation procedures. 

When compared to best practices, NOAA’s satellite and ground system 
contingency plans had many strengths and a few weaknesses. 
Specifically, the satellite contingency plan fully implemented seven 
elements, partially implemented nine elements, and did not implement 
one element. The ground system contingency plan fully implemented ten 
elements, partially implemented six elements, and one element was not 
applicable. Table 17 shows the extent to which the satellite and ground 
system contingency plans fully implemented, partially implemented, or did 
not implement key contingency planning elements. 


Table 17: Implementation of Key Contingency Planning Elements for Geostationary Operational Environmental Satellites 


Category 

Key element 

Satellite 

system 

Ground 

system 

Description 

Identifying 

failure 

scenarios and 
impacts 

Define likely failure 
scenarios 

Fully 

implemented 

Fully 

implemented 

NOAA has defined three likely failure scenarios for its 
satellite system — the loss of one, two, or all three satellites 
in the GOES constellation. The agency also defines the 
conditions that would constitute a satellite failure. NOAA's 
scenarios are broad enough that they cover a wide range of 
situations, including a gap caused by a delay in the 

GOES-R launch. NOAA has defined likely ground system 
failure scenarios. 


Conduct impact analyses 
showing impact of failure 
scenarios on business 
processes and user 
requirements 

Not 

implemented 

Partially 

implemented 

NOAA did not conduct impact analyses showing the impact 
of satellite failure scenarios on business processes or user 
requirements. 

NOAA conducted impact analyses of ground system 
outages and disruptions on business processes and user 
requirements; however, these analyses do not reflect each 
failure scenario. 


Define minimum 
acceptable level of 
outputs and recovery 
time objectives, and 
establish resumption 
priorities 

Fully 

implemented 

Fully 

implemented 

NOAA defined minimum acceptable output criteria for 
satellites, instruments and products in its satellite plans as 
well as for business processes and subsystems in the 
ground system plans. 
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Category 

Key element 

Satellite 

system 

Ground 

system 

Description 

Developing 

contingency 

plans 

Define roles and 
responsibilities for 
implementing 
contingency plans 

Partially 

implemented 

Partially 

implemented 

NOAA has defined roles and responsibilities for some, but 
not ail, contingency operations in both the satellite and 
ground system plans. For example, the satellite contingency 
plan identifies roles and responsibilities for briefing 
management in the event of losing an operational satellite, 
but does not define responsibility for notifying users. The 
ground system contingency plans describe roles and 
responsibilities of three contingency teams, but do not 
clearly define the roles and responsibilities for the 
contingency coordinator. 


Identify alternative 
solutions to address 
failure scenarios 

Partially 

implemented 

Fully 

implemented 

In its satellite contingency plan, NOAA identified alternative 
solutions to address satellite failure scenarios, including 
relocating and using older GOES satellites and requesting 
coverage by foreign satellites. However, NOAA did not 
identify alternative solutions for preventing delays in the 
GOES-R launch, which could cause a reduction in the 
number of satellites. For its ground systems, NOAA 
identified a solution for its failure scenarios: to switch 
operations to one of several backup locations. 


Select contingency 
strategies from among 
alternatives based on 
costs, benefits, and 
impacts 

Partially 

implemented 

Partially 

implemented 

In both sets of plans, NOAA has selected contingency 
strategies to address failure scenarios; however, it did not 
provide evidence that it had selected these strategies from 
alternatives based on costs, benefits, and impacts. 

Moreover, NOAA did not select strategies to prevent one of 
the most likely situations that would trigger a failure 
scenario; a delay in the launch of the GOES-R satellite. 


Develop "zero-day ” 
procedures 

Partially 

implemented 

Fully 

implemented 

NOAA identified strategies and procedures for addressing 
GOES satellite failure scenarios, but did not establish 
associated time frames. NOAA developed zero-day 
strategies and procedures for the GOES ground system. 


Define actions needed to 
implement contingency 
strategies 

Partially 

implemented 

Fully 

implemented 

NOAA has defined high-level activities to implement satellite 
contingency strategies, such as relocation of a satellite to a 
centra! location and user notification of a switch to a single 
satellite— however, no detailed procedure steps are given 
for performance of these activities. NOAA has defined the 
steps to implement GOES ground system contingency 
strategies. 


Define and document 
triggers and time lines for 
enacting the actions 
needed to implement 
contingency plans 

Partially 

implemented 

Partially 

implemented 

NOAA has identified triggers and specific time lines for 
implementing satellite contingency plans. However, it has 
not established triggers or time lines for any actions it might 
take to prevent a delay in the GOES-R launch. 

NOAA has identified two different triggers for enacting the 
ground system plan, but the plan does not describe which 
trigger is to be used. 
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Category 

Key element 

Satellite 

system 

Ground 

system 

Description 


Ensure that steps reflect 
priorities for resumption 
of products and recovery 
objectives 

Partially 

implemented 

Partially 

implemented 

NOAA's satellite contingency pian describes its recovery 
objectives and prioritizes GOES instruments and products; 
however, the steps for implementing contingency strategies 
do not reflect these priorities and objectives. Ground system 
contingency strategies establish priorities for resuming 
operations, but do not define recovery time objectives. 


Designated officials 
review and approve 
contingency plan 

Fully 

implemented 

Fully 

implemented 

A designated official has reviewed and approved both sets 
of contingency plans. 

Validating and 
implementing 
contingency 
plans 

identify steps for testing 
contingency plans and 
conducting training 
exercises 

Fully 

implemented 

Fully 

implemented 

NOAA has identified steps fortesting GOES satellite 
contingency plans and has conducted exercises and 
simulations. NOAA has also identified steps for testing and 
conducting exercises and simulations on its ground system 
contingency plans. NOAA provides training to its operations 
staff on contingency operations for both the satellite and 
ground systems. 


Prepare for and execute 
tests 

Fully 

implemented 

Fully 

implemented 

NOAA officials provided documentation showing preparation 
for and execution of regular maneuvers of on-orbit satellites. 
AcDDrding to officials, these maneuvers are similar to the 
maneuvers identified as an action in the contingency plans. 
NOAA also prepared for and executed tests of its ground 
system contingency plans. 


Execute applicable 
actions for 
implementation of 
contingency strategies 

Fully 

implemented 

Not 

Applicable 

NOAA has performed actions to implement contingency 
strategies, including activities to monitor the health and 
safety of the satellites, and to provide status information to 
management. Executing actions is not applicable for the 
ground system contingency plan, because that plan does 
not identify actions to be taken at the present time. 


Validate test results for 
consistency against 
minimum performance 
levels 

Partially 

implemented 

Fully 

implemented 

NOAA tested a series of satellite maneuvers similar to those 
that would be used in the event of a failure, but did not 
demonstrate how these or other scenario tests would meet 
minimum performance levels. On the ground system, NOAA 
performed tests to validate contingency operations, and 
demonstrated that the transfer of responsibility meets 
minimum recovery performance levels. 


Communicate and 
coordinate with 
stakeholders to ensure 
that contingency 
strategies remain optimal 
for reducing potential 
impacts 

Partially 

implemented 

Partially 

implemented 

According to users. NOAA is proactive in communicating 
potential changes and impacts when issues develop, and 
responded quickly to a recent outage in a GOES satellite. 
However, the contingency strategies currently in place of (1) 
switching to single satellite operations and (2) using a 
foreign satellite as a temporary replacement would have a 
major effect on user operations; NOAA has not provided key 
external users with information on meeting data needs 
under these scenarios. For example, the Forest Service 
relies on GOES satellites to obtain data from its distributed 
ground-based observation network, but NOAA has not 
discussed potential mitigation options specific to this 
scenario. 
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Category 

Key element 

Satellite 

system 

Ground 

system 

Description 


Update and maintain 
contingency plans as 
warranted 

Fully 

implemented 

Fully 

implemented 

NOAA has updated and maintained contingency plans for 
both the GOES satellites and ground system. 


Source: GAO analysis of NOAA documentation. 


NOAA has implemented most of the best practices on both the GOES 
satellite and ground contingency plans. Specifically, NOAA identified 
failure scenarios, recovery priorities, and minimum levels of acceptable 
performance. NOAA also established contingency plans that identify 
solutions and high-level activities and triggers to implement the solutions. 
Further, the agency has tested its contingency plans, trained staff on how 
to implement the contingency plans, and updated the plans when 
warranted. The agency also successfully implemented its contingency 
plans when it experienced problems with one of its operational satellites. 
Specifically, when GOES-1 3 experienced problems in September and 
October 2012, NOAA activated its contingency plans to move its back-up 
satellite into position to provide observations until GOES-13 was once 
again operational. While the agency has not needed to address the loss 
of a back-up satellite in recent years, contingency plans cover this 
situation by determining if older GOES satellites could provide coverage, 
moving the single satellite into a central position over the country, and 
seeking data from foreign satellites. 

However, both satellite and ground contingency plans contain areas that 
fall short of best practices. For example, NOAA has not demonstrated 
that the contingency strategies for both its satellite and ground system are 
based on an assessment of costs, benefits, and impact on users. Further, 
the satellite plan does not specify procedures for working with the user 
community to account for potential reductions in capability under 
contingency operations. For example, officials from the Federal Aviation 
Administration noted that NOAA’s contingency plans do not define the 
compatibility, security, and standard protocol language they should use if 
a foreign satellite were to be utilized. Also, while selected users reported 
that, in the past, they have been well informed by NOAA when changes in 
service occur, including the problems with GOES-13, others were either 
not informed or received information on outages through a third party. 
Moreover, selected users stated that certain contingency operations could 
have a significant impact on their operations. For example, Federal 
Aviation Administration officials stated that flight approaches in Alaska 
that were enabled using the Global Positioning System were affected by 
the GOES-13 outage in late 2012. As another example, Forest Service 
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officials explained that if GOES were to experience an outage and not 
have a backup satellite available, it was their understanding that NOAA 
would either move a single satellite into a central position over the country 
or obtain observations from a foreign satellite. Under both of these 
scenarios, they could lose views of wildland fires and their ability to obtain 
data from ground-based observation networks. Nearly all users stated 
that the effects of a switch to a single satellite or foreign satellite 
configuration would be significant. 

In addition, while NOAA’s failure scenarios for its satellite system are 
based on the number of available satellites — and the loss of a backup 
satellite caused by a delayed GOES-R launch would fit into these 
scenarios — the agency did not identify alternative solutions or time lines 
for preventing a GOES-R launch delay. According to NOAA officials, a 
gap caused by a delayed launch would trigger the same contingency 
actions as a failure on launch or the loss of a currently on-orbit satellite. 
However, this does not take into account potential actions that NOAA 
could undertake to prevent a delayed launch, such as removing selected 
functionality or compressing test schedules. 

NOAA officials stated that their focus on primary users and on the number 
of available satellites is appropriate for their contingency plans. Given the 
potential for a delay in the launch of the GOES-R satellite and the 
expectation that there will be at least a year with no backup satellite in 
orbit, it is important that NOAA consider ways to prevent a delay in the 
GOES-R launch, and ensure its contingency plans are fully documented, 
tested, and communicated to affected stakeholders. Further, it is critical 
that NOAA and users are aware of how contingency scenarios will affect 
user operations. Until comprehensive plans are developed, it is less 
certain that NOAA can provide a consistent level of service and 
capabilities in the event of an early failure or late launch. This in turn 
could have a devastating effect on the ability of meteorologists to observe 
and report on severe weather conditions. 


Conclusions 


The GOES-R program is well on its way toward developing the first 
satellite in the series, but it continues to face risks that could delay the 
first satellite’s launch. Among these risks are issues we have previously 
raised on how the program manages reserve funds and implements 
sound scheduling practices. Specifically, the agency does not provide 
important details on its contingency reserve funds to senior executives, 
including the reserves allocated for each of the four satellites or key 
assumptions made in calculating reserves. Without this information, 
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program officials could misinterpret the size of the remaining reserves 
and make poor decisions regarding the program’s future funding. The 
agency has improved selected scheduling practices, but others remain 
weak — in part, according to agency officials, due to the dynamic nature of 
scheduling a program as complex as the GOES-R satellite program. As 
the agency closes in on its expected launch date, technical issues in 
developing the space and ground segments and scheduling problems 
couid make it more difficult to launch on schedule, and program officials 
now acknowledge that the launch date may be delayed by 6 months. Any 
delay in the anticipated launch date would expand a potential one-year 
gap in the availability of an on-orbit backup GOES satellite, and raise the 
risk of a gap in geostationary satellite data should one of the two 
operational satellites experience a problem. 

While the agency has made multiple changes to GOES-R requirements in 
recent years, it has not effectively involved satellite data users in those 
changes. Specifically, internal NOAA and external satellite data users 
were not fully informed about changes in GOES-R requirements and did 
not have a chance to communicate their concerns about the impact these 
changes couid have on their ability to perform their missions. Many of 
these users expressed concerns about the effect these changes could 
have on their ability to fulfill their missions, including facilitating air traffic, 
conducting military operations, and fighting wildland fires. Until NOAA 
improves its outreach and communication with external satellite data 
users, its changes in requirements could cause unexpected impacts on 
critical user operations. 

Given the possibility of a gap in geostationary satellite coverage, NOAA 
has established contingency plans for both its GOES satellites and 
ground systems; these plans include the likely scenario in which there will 
not be an on-orbit backup. While these plans include many elements 
called for in industry best practices, the satellite contingency plan did not 
assess the potential impacts of a failure on users, or specify actions for 
working with the user community to address these potential reductions in 
capability under contingency operations. They also did not identify 
alternative solutions or time lines for preventing a delay in the GOES-R 
launch date. The absence of a fully-tested and complete set of GOES-R- 
related contingency plans and procedures could have a major impact on 
levels of service provided in the event of a satellite or ground system 
failure. 
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Rpf nmmpnHaHnnc; for To address risks in the GOES-R program development and to help 

t u ensure that the satellite is launched on time, we are making the following 

Executive Action four recommendations to the Secretary of Commerce. Specifically, we 

recommend that the Secretary of Commerce direct the NOAA 

Administrator to: 

• Direct program officials to include information on the amount of 
reserve funding for each of the four satellites in the program as well 
as information on the calculation and use of reserves in regular 
briefings to NOAA senior executives, so that executives are fully 
informed about changes in reserve levels. 

• Given the likely gap in availability of an on-orbit GOES backup 
satellite in 2015 and 2016, address the weaknesses identified in this 
report on the core ground system and the spacecraft schedules. 
These weaknesses include, but are not limited to, sequencing all 
activities, ensuring there are adequate resources for the activities, and 
conducting a schedule risk analysis. 

• Improve communications with internal and external satellite data 
users on changes in GOES-R requirements by (a) assessing the 
impact of changes on user’s critical operations: (b) seeking 
information from users on any concerns they might have about past or 
potential changes; and (c) disseminating information on past and 
potential changes in requirements to satellite data users. 

. Revise the satellite and ground system contingency plans to address 
weaknesses identified in this report, including providing more 
information on the potential impact of a satellite failure, identifying 
alternative solutions for preventing a delay in GOES-R launch as well 
as time lines for implementing those solutions, and coordinating with 
key external stakeholders on contingency strategies. 


Agency Comments 
and Our Evaluation 


We sought comments on a draft of our report from the Department of 
Commerce and NASA. We received written comments on a draft of this 
report from Commerce transmitting NOAA’s comments. NOAA concurred 
with all four of our recommendations and identified steps that it is taking 
to implement them. It also provided technical comments, which we have 
incorporated into our report, as appropriate. NOAA’s comments are 
reprinted in appendix II. 

While NOAA concurred with our recommendation to include information 
on reserve funding for each of the four satellites in the program and 
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information on the calculation and use of reserves in regular briefings to 
senior executives, and suggested that its current processes fulfill this 
recommendation, we do not believe they do. Specifically, NOAA stated 
that the GOES-R program currently reports on reserve funding at two 
major monthly management meetings, which alerts management if 
reserves fall below designated thresholds for the remaining work on all 
four satellites. The agency also stated that its reporting of the percent of 
“unliened" contingency funding — the amount of contingency funding not 
allocated to a potential risk or issue — -for the remaining work addresses 
our concern regarding whether there are sufficient reserves to complete 
the GOES-R series. 

However, the GOES-R program does not currently identify the reserve 
funding needed for each individual satellite or provide details on how 
reserves are being calculated and used at the monthly management 
meetings. By not providing reserve information on the individual satellites, 
the program is not alerting management about potential near-term 
funding shortfalls. For example, maintaining a high level of reserves on 
the later satellites could mask a low level of reserves in the near-term for 
GOES-R and S. Such a scenario could affect the satellites’ development 
schedules and launch dates. Further, by not obtaining details on the 
assumptions made when calculating reserves and the causes of changes 
in reserve values, management is unable to determine if changes in 
reserve levels are due to the addition, subtraction, or use of funds, or to 
changes in the assumptions used in the calculations. Given the 
importance of reserve funds in ensuring the satellite development 
remains on track, management should be aware of reserve funding levels 
for each individual satellite and of the underlying reasons for changes in 
reserve levels. Therefore, we continue to believe that additional action is 
needed by NOAA to respond to our recommendation. 

After we received agency comments and while our report was in final 
processing, NOAA notified us that the launch dates of the first and 
second GOES-R series satellites would be delayed. Given the late receipt 
of this information, our report reflects the previous launch date. 

NASA did not provide comments on the report’s findings or 
recommendations, but noted that it would provide any input it might have 
to NOAA for inclusion in that agency’s comments. 
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As agreed with your offices, unless you publicly announce the contents of 
this report earlier, we plan no further distribution until 30 days from the 
report date. At that time, we will send copies to interested congressional 
committees, the Secretary of Commerce, the Administrator of NASA, the 
Director of the Office of Management and Budget, and other interested 
parties. The report also will be available at no charge on the GAO website 
at http://www.gao.gov. 

If you or your staff have any questions on the matters discussed in this 
report, please contact me at (202) 512-9286 or at pownerd@gao.gov. 
Contact points for our Offices of Congressional Relations and Public 
Affairs may be found on the last page of this report. GAO staff who made 
major contributions to this report are listed in appendix III. 

a. 

David A. Powner 
Director, Information Technology 
Management Issues 
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Appendix I: Objectives, Scope, and 
Methodology 


Our objectives were to (1) assess the National Oceanic and Atmospheric 
Administration’s (NOAA) progress in developing the Geostationary 
Operational Environmental Satellite-R series (GOES-R) program and in 
addressing key cost and schedule risks that we identified in a prior report, 
(2) evaluate the program’s efforts to manage changes in requirements 
and whether any significant changes have recently occurred, and (3) 
evaluate the adequacy of GOES-R contingency plans. 

To assess NOAA's progress in developing the GOES-R satellite program, 
we compared the program’s planned completion dates for key milestones 
identified in its management control plan and system review plan against 
actual and currently estimated completion dates. We analyzed monthly 
program status briefings to identify the current status and recent 
development challenges of flight and ground project components and 
instruments. To assess NOAA’s efforts to address key cost risks, we 
compared program-reported data on development costs and reserves to 
best practices in reserve funding as identified by the program's 
management control plan, which, in turn, reflects National Aeronautics 
and Space Administration requirements. We calculated reserve 
percentages using program office data on development costs and 
reserves, and compared these calculations to the reserve percentages 
reported by the program to management. To assess NOAA’s efforts to 
address key schedule risks, we compared schedules for two key GOES-R 
components to best practices in schedule development as identified in 
our Cost Estimating and Assessment Guide. 1 Similar to our previous 
report, we used a five-part rating system. We then compared our previous 
assessment to our current assessment to identify practices that were 
improved, stayed the same, or became weaker overtime. We conducted 
interviews with GOES-R program staff to better understand milestone 
time frames, to discuss current status and recent development challenges 
for work currently being performed on GOES-R, and to understand how 
the program reports costs and reserve totals. We also examined the 
reliability of data on cost reserves and program schedules. Regarding 
cost reserves, we examined reliability by recalculating reserve 


1 See GAO, GAO Cost Estimating and Assessment Guide: Best Practices for Developing 
and Managing Capital Program Costs, GAO-09-3SP (Washington, D.C.; Mar. 2009). In 
May 2012, GAO published updated guidance on scheduling best practices. See GAO, 
Schedule Assessment Guide: Best Practices for Project Schedules— Exposure Draft, 
GAO-1 2-1 20G (Washington, DC.: May 30, 2012). The updated guidance identifies 10 
best practices. In order to compare past and current results, we conducted our current 
assessment using the original 9 practices. 
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percentages based on supporting data over a period of one year, and 
compared the results to those presented by the program to management. 
Regarding schedules, we created a template that examined each 
schedule in areas such as missing logic, tasks completed out of 
sequence, and completed tasks with start or finish dates in the future. As 
a result, we found both the reserve information and the schedules to be 
reliable for the purposes of conducting our analyses. 

To evaluate the program’s efforts to manage changes in requirements, 
we compared GOES-R practices for managing requirements changes 
against best practices, which we drew from several leading industry 
sources including the Software Engineering institute’s Capability Maturity 
ModeKgMntegration, the Program Management Institute’s Program 
Manager's Body of Knowledge, the Federal Information Security Controls 
Audit Manual and the Information Technology Governance Institute’s 
Control Objectives for Information and related Technology governance 
framework. We assessed GOES-R practices as having satisfied, partially 
satisfied, or not satisfied each best practice. We analyzed changes from 
2007 to the present in the program’s Level I Requirements Document to 
determine the extent of the changes. We also identified concerns about 
these changes from a subset of satellite data users. We selected users 
from both inside and outside NOAA’s National Weather Service, the main 
GOES satellite user, based on several factors: the importance of GOES 
data to the organization’s core mission, the user’s reliance on GOES 
products that have changed or may change, and — for agencies outside of 
NOAA — the percentage of spending devoted to meteorological 
operations. The user organizations outside of NOAA included in our 
review were: the US Department of Agriculture, the Department of 
Transportation’s Federal Aviation Administration, and the Department of 
Defense’s Navy and Air Force. User organizations inside of NOAA’s 
National Weather Service included the Aviation Weather Center, Space 
Weather Prediction Center, Storm Prediction Center, Environmental 
Modeling Center, and a Weather Forecast Office. 

To evaluate the adequacy of GOES-R contingency plans, we compared 
contingency plans and procedures for both GOES satellites and the 
GOES ground system against best practices developed from leading 
industry sources such as the National Institute of Standards and 
Technology, the Software Engineering Institute’s Capability Maturity 
Model®-lntegration, and our prior work. We analyzed the contingency 
plans to identify strategies for various failure scenarios and determined 
whether the satellite and ground system contingency plans fully 
implemented, partially implemented, or did not implement each of the 
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practices. We also interviewed selected satellite data users to better 
determine the impact of a GOES failure scenario on their operations, and 
the level of communication they have had with NOAA satellite offices on 
current contingency plans. 

We performed our work at NOAA, National Aeronautics and Space 
Administration, and US Department of Agriculture offices in the 
Washington, D.C., area and at National Weather Service offices in 
Kansas City, Missouri; Norman, Oklahoma; and Sterling, Virginia. We 
conducted this performance audit from October 2012 to September 201 3, 
in accordance with generally accepted government auditing standards. 
Those standards require that we plan and perform the audit to obtain 
sufficient, appropriate evidence to provide a reasonable basis for our 
findings and conclusions based on our audit objectives. We believe that 
the evidence obtained provides a reasonable basis for our findings and 
conclusions based on our audit objectives. 
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Appendix II: Comments from the Department 
of Commerce 



THE DEPUTY SECRETARY OF COMMERCE 


July 5,2013 


Mr. David A. Powner 

Director, Information Technology Management Issues 
U.S. Government Accountability Office 
441 G Street, NW 
Washington, DC 20548 

Dear Mr. Powner: 


Thank you for the opportunity to review and comment on the U.S. Government 
Accountability Office’s draft report entitled, “Geostationary Weather Satellites: Progress Made, 
but Weaknesses in Scheduling, Contingency Planning, and Communicating with Users Need to 
be Addressed” (GAO- 1 3-597). On behalf of the Department of Commerce, i have enclosed the 
National Oceanic and Atmospheric Administration’s programmatic comments to the draft report. 


If you have any questions, please contact me or Jim Stowers, Deputy Assistant Secretory 
for Legislative and Intergovernmental Affairs, at (202) 482-3663. 


linccfely, 

UZl 


Patrick Gallagher 

Acting Deputy Secretary of Commerce 
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U.S. Department of Commerce 
National Oceanic and Atmospheric Administration 
Comments to the Draft GAO Report Entitled, 

“Geostationary Weather Satellites: Progress Made, 
but Weaknesses in Scheduling, Contingency Planning, 
and Communicating with Users Need to be Addressed” 

(GAO-13-597, July 2013) 

General Comments 

The Department of Commerce appreciates the opportunity to review the U.S. Government 
Accountability Office’s (GAO) draft report. Throughout the report, when referring to the 
program in whole, use “the GOES-R Series Program.” This is to ensure a clear distinction 
between the overall program and the first satellite in this series (i.e., GOES-R). 

NOAA Response to GAO Recommendations 

Recommendation 1: “Direct program officials to include information on the amount of reserve 
funding for each of the four satellites in the program as well as information on the calculation 
and use of reserves in regular briefings to NOAA senior executives, so that executives are fully 
informed about changes in reserve levels.” 

NOAA Response: Concur. The GOES-R Series Program currently reports contingency 
amounts (reserves) to the Goddard Space Flight Center (GSFC) monthly Management Status 
Review (MSR) and the National Oceanic and Atmospheric Administration (NOAA) monthly 
Program Management Council (PMC) meeting. The unliened contingency amount is reported 
as a dollar amount and as a percentage of unexecuted work-to-go. This approach alerts 
management to a contingency falling below the required levels for work-to-go, including 
work on GOES-R, S, T, and U. NOAA Leadership will continue the ongoing process of 
working with GOES-R Series Program to ensure contingency reporting meets its requirements 
for detailed information, and ensure reporting is revised accordingly. The percent of unliened 
contingency on work-to-go, which is reported monthly to management by the GOES-R 
Program, specifically addresses GAO’s concern regarding sufficient reserves to complete the 
GOES-R Series. 

Recommendation 2: “Given the likely gap in availability of an on-orbit GOES backup satellite 
in 2015 and 2016 . address the weaknesses identified in this report on the core ground systems 
and spacecraft schedules. These weaknesses include, but are not limited to, sequencing all 
activities, ensuring there are adequate resources for the activities, and conducting a schedule risk 
analysis." 

NOAA Response: Concur. The GOES-R Series Program conducts monthly health checks of 
the spacecraft, instrument, and ground segment schedules and works with the contractors to 
resolve the issues identified. The Program Integrated Master Schedule (IMS) is built from the 
contractor schedule submissions, which are summarized into flight and ground segment 
schedules that are then integrated to form (he Program IMS. The contractor schedules do reflect 
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the appropriate subcontractor activities. The integration and summarization process provides an 
end-to-end critical path and the amount of schedule slack for that critical path. Schedule 
performance information is also monitored and reported in a number of non-schedule ways. For 
example, milestones executed versus planned, engineering products executed versus planned, 
reviews {requirements, design, manufacturing, etc.) executed versus planned, and progress on 
subcontract and procurement activities. Flight, Ground, and Program schedule information is 
reported to the GSFC monthly Management Status Reviews and the NOAA monthly PMC 
meetings. The GOES-R Series Program will continue to bring down the number of errors in the 
schedules and improve the fidelity of the Program IMS. 

Recommendation 3: '‘improve communications with interna! and external satellite data users 
on changes in GOES-R requirements by (a) assessing the impact of changes on user’s critical 
operations; (b) seeking information from users on any concerns they might have about past or 
potential changes; and (c) disseminating information on past and potential changes in 
requirements to satellite data users.” 

NOAA Response: Concur. Tlie GOES-R Series Program has an active process for 
communicating Program status to stakeholders and soliciting their input. GOES-R Series 
Program has extensive interaction with users which takes place at meetings such as the recent 
NOAA Satellite Conference, the NOAA Satellite Science Week, GOES-R Risk Reduction and 
Algorithm Development Executive Board (ADEB) meetings. Additional interaction takes place 
at the GOES User's Conference, the Annual American Meteorological Society (AMS) .Meeting, 
sponsor meetings (including DoD and Canada) at the Cooperative Program for Meteorology 
Education and Training (COMET), and the annual GOES-R status briefing to the Office of the 
Federal Coordinator for Meteorology (OFCM). 

The GOES-R Series Program will endeavor to further improve its communications with its 
internal and external satellite data users and will consider new opportunities to disseminate 
information about forthcoming changes in the GOES-R era. These may include: Notional 
Weather Service (NWS) Customer Forums which are held twice per year to discuss ‘‘Family of 
Service” and other NWS data flows to the private sector, increased engagement with broadcast 
meteorologists, and improved dissemination of information with the direct read-out community. 

Recommendation 4: “Revise the satellite and ground system contingency plans to address 
weaknesses identified in the report, including providing more information on the potential 
Impact of a satellite failure, identifying alternative solutions fnr preventing a delay in GOES-R 
launch as well as time lines for implementing those solutions, and coordinating with key external 
stakeholders on contingency strategies." 

NOAA Response: Concur. NOAA will update its satellite and ground system contingency 
plans to address weaknesses identified in the report. In addition, the GOES-R Series Program 
will provide regular updates to NOAA, the Department, the Office of Management and Budget, 
and Congress on efforts underway to protect the launch schedule, as part of the regular monthly 
and quarterly program reviews and will continue to use existing mechanisms to communicate 
program status to key stakeholders. 
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POLAR WEATPIER SATELLITES 

NOAA Identified Ways to Mitigate Data Gaps, but 
Contingency Plans and Schedules Require Further 
Attention 


What GAO Found 

The National Oceanic and Atmospheric Administration (NOAA) has made 
noteworthy progress on the Joint Polar Satellite System (JPSS) program by 
delivering data from its first satellite — the Suomi National Polar-orbiting 
Partnership (S-NPP) — to weather forecasters, completing significant instrument 
development for the next satellite (called JPSS-1), and reducing the program’s 
life cycle cost estimate from $12.9 billion to $1 1.3 billion by refocusing on 
weather products. However, key challenges remain. Specifically, S-NPP has not 
yet achieved full operational capability because the program is behind schedule 
in validating the readiness of satellite products. Also, the program does not track 
whether key users are using its products or if the products meet the users’ 
needs. In addition, issues with the JPSS ground system schedules have delayed 
the delivery of key system capabilities. Until the program addresses these 
challenges, it may continue to experience delays in delivering actionable S-NPP 
data to system users and in meeting JPSS-1 development schedules. 

A program's success depends in part on having an integrated master schedule 
that defines when and how long work will occur and how activities are related to 
each other; however, the JPSS program office does not yet have a complete 
integrated master schedule and weaknesses exist in component schedules. 
Specifically, the program established an integrated master schedule in June 
2013 and is reporting a 70 percent confidence level in the JPSS-1 launch date. 
However, about one-third of the program schedule is missing information needed 
to establish the sequence in which activities occur. In addition, selected 
component schedules supporting the JPSS-1 satellite have weaknesses 
including schedule constraints that have not been justified. Until the program 
completes its integrated schedule and addresses weaknesses in component 
schedules, it will lack the information needed to effectively monitor development 
progress and have less assurance of meeting the planned JPSS-1 launch date. 

While NOAA developed a mitigation plan to address a potential 14 to 18 month 
gap in afternoon polar satellite data in October 2012 and subsequently identified 
additional alternatives for addressing potential gaps, it has not yet established a 
comprehensive contingency plan. Specifically, NOAA has not yet revised its 
mitigation plan to include the new alternatives, and the plan lacks several key 
elements, such as triggers for when to take key actions and detailed procedures 
for implementing them. Until NOAA establishes a comprehensive plan, it may not 
be sufficiently prepared to mitigate anticipated gaps in polar satellite coverage. 


Figure: Timeline for a Potential Gap in Polar Satellite Data in the Afternoon Orbit 
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GAO 

441 G St. N.W. 
Washington, DC 20548 


GOVERNMENT ACCOUNTABILITY OFFICE 


September 11, 2013 

The Honorable Lamar Smith 
Chairman 

The Honorable Ralph Hall 
Chairman Emeritus 
The Honorable Eddie Bernice Johnson 
Ranking Member 

Committee on Science, Space, and Technology 
House of Representatives 

The National Polar-orbiting Operational Environmental Satellite System 
(NPOESS) program was planned to be a state-of-the-art, environment- 
monitoring satellite system that would replace two existing polar-orbiting 
environmental satellite systems. Managed jointly by the Department of 
Commerce’s National Oceanic and Atmospheric Administration (NOAA), 
the Department of Defense (DOD)/U.S. Air Force, and the National 
Aeronautics and Space Administration (NASA), the program was 
considered critical to the nation’s ability to maintain the continuity of data 
required for weather forecasting and global climate monitoring through 
the year 2026. 

However, in the 8 years after the development contract was awarded in 
2002, the NPOESS cost estimate had more than doubled— to about $15 
billion, launch dates had been delayed by over 5 years, significant 
functionality had been removed from the program, and the program’s tri- 
agency management structure had proven to be ineffective. Importantly, 
delays in launching the satellites put the program’s mission at risk. To 
address these challenges, a task force led by the White House’s Office of 
Science and Technology Policy reviewed the management and 
governance of the NPOESS program. In February 2010, the Director of 
the Office of Science and Technology Policy announced a decision to 
disband the NPOESS acquisition and, instead, have NOAA and DOD 
undertake separate acquisitions, with NOAA responsible for satellites in 
the afternoon orbit and DOD responsible for satellites in the early morning 
orbit. After that decision, NOAA began developing plans for the Joint 
Polar Satellite System (JPSS). In October 2011, the JPSS program 
successfully launched the Suomi National Polar-orbiting Partnership 
(S-NPP) demonstration satellite, the first in a series of satellites to be 
launched as part of NOAA’s JPSS program. 
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Given your interest in the progress NOAA has made on the JPSS 
program, our objectives were to (1) evaluate NOAA's progress in meeting 
program objectives of sustaining the continuity of the polar-orbiting 
satellite system through the S-NPP and JPSS satellites, (2) evaluate the 
quality of the JPSS program schedule, and (3) assess NOAA’s plans to 
address potential gaps in polar satellite data. 

To evaluate NOAA's progress in meeting its program objectives, we 
analyzed plans and reports on the satellites’ system development efforts 
and on the maturity of S-NPP products. We compared current 
requirements to prior iterations to assess how recent changes in 
capabilities have impacted program goals and objectives. We also 
interviewed JPSS program officials to discuss S-NPP product 
development, JPSS system development, and changes in requirements 
for JPSS satellites. To evaluate the quality of NOAA’s program schedule, 
we used an exposure draft of GAO’s Schedule Assessment Guide 1 to 
assess component contractor schedules as well as the program’s 
schedule risk analysis and interviewed cognizant JPSS program office 
and contractor officials. To assess NOAA’s plans to address potential 
gaps in polar satellite data, we compared NOAA’s gap mitigation plan and 
contracted alternatives study against risk mitigation and contingency best 
practices from GAO and advocated by leading organizations, 2 determined 
planning shortfalls and key remaining activities for NOAA to accomplish, 
and interviewed NOAA headquarters and JPSS program officials about 
their plans. 

We conducted this performance audit from October 2012 through 
September 2013 in accordance with generally accepted government 
auditing standards. Those standards require that we plan and perform the 
audit to obtain sufficient, appropriate evidence to provide a reasonable 
basis for our findings and conclusions based on our audit objectives. 
Additional details on our objectives, scope, and methodology are provided 
in appendix I. 


1 GAO Schedule Assessment Guide: Best Practices for Project Schedules, GAO-12-120G 
(exposure draft) (Washington, D.C.: May 30, 2012). 

2 See GAO, Year 2000 Computing Crisis: Business Continuity and Contingency Planning, 
GAO/AIMD-IO.1.19 (Washington, D.C.: August 1998); National Institute of Standards and 
Technology. Contingency Planning Guide for Federal Information Systems, NIST 800-34 
(May 2010); Software Engineering Institute, CMMI® for Acquisition, Version 1.3 
(Pittsburgh, Pa.: November 2010). 
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Background 


Since the 1960s, the United States has operated two separate 
operational polar-orbiting meteorological satellite systems: the Polar- 
orbiting Operational Environmental Satellite (POES) series, which is 
managed by NOAA, and the Defense Meteorological Satellite Program 
(DMSP), which is managed by the Air Force. 3 These satellites obtain 
environmental data that are processed to provide graphical weather 
images and specialized weather products. These satellite data are also 
the predominant input to numerical weather prediction models, which are 
a primary tool for forecasting weather days in advance — including 
forecasting the path and intensity of hurricanes. The weather products 
and models are used to predict the potential impact of severe weather so 
that communities and emergency managers can help prevent and 
mitigate its effects. Polar satellites also provide data used to monitor 
environmental phenomena, such as ozone depletion and drought 
conditions, as well as data sets that are used by researchers for a variety 
of studies such as climate monitoring. 

Unlike geostationary satellites, which maintain a fixed position relative to 
the earth, polar-orbiting satellites constantly circle the earth in an almost 
north-south orbit, providing global coverage of conditions that affect the 
weather and climate. Each satellite makes about 14 orbits a day. As the 
earth rotates beneath it, each satellite views the entire earth’s surface 
twice a day. Currently, there is one operational POES satellite and two 
operational DMSP satellites that are positioned so that they cross the 
equator in the early morning, midmorning, and early afternoon. In 
addition, the government relies on a European satellite, called the 
Meteorological Operational (MetOp) satellite, for satellite observations in 
the midmorning orbit. 4 In addition to the operational satellites, NOAA, the 
Air Force, and a European weather satellite organization maintain older 
satellites that still collect some data and are available to provide limited 
backup to the operational satellites should they degrade or fail. The last 
POES satellite was launched in February 2009. The Air Force plans to 


3 NOAA provides command and control for both the POES and DMSP satellites after they 
are in orbit. 

4 The European Organisation for the Exploitation of Meteorological Satellites’ MetOp 
program is a series of three polar-orbiting satellites dedicated to operational meteorology. 
MetOp satellites are planned to be flown sequentially over 14 years. The first of these 
satellites was launched in 2006, the second was launched in 2012, and the final satellite in 
the series is expected to launch in 2017. 
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launch its two remaining DMSP satellites as needed. Figure 1 illustrates 
the current operational polar satellite constellation. 


Figure 1: Configuration of Operational Polar Satellites 



Sources. GAO. based on NPOESS integrated Program Office and DOO data, Map Resources (globe). 


Polar Satellite Data and Polar satellites gather a broad range of data that are transformed into a 
Products variety of products. Satellite sensors observe different bands of radiation 

wavelengths, called channels, which are used for remotely determining 
information about the earth’s atmosphere, land surface, oceans, and the 
space environment. When first received, satellite data are considered raw 
data. To make them usable, processing centers format the data so that 
they are time-sequenced and include earth-location and calibration 
information. After formatting, these data are called raw data records. The 
centers further process these raw data records into channel-specific data 
sets, called sensor data records and temperature data records. These 
data records are then used to derive weather and climate products called 
environmental data records. These environmental data records include a 
wide range of atmospheric products detailing cloud coverage, 
temperature, humidity, and ozone distribution; land surface products 
showing snow cover, vegetation, and land use; ocean products depicting 
sea surface temperatures, sea ice, and wave height; and 
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characterizations of the space environment. Combinations of these data 
records (raw, sensor, temperature, and environmental data records) are 
also used to derive more sophisticated products, including outputs from 
numerical weather models and assessments of climate trends. Figure 2 is 
a simplified depiction of the various stages of satellite data processing, 
and figure 3 depicts examples of two different weather products. 


Figure 2: Stages of Satellite Data Processing 
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The NPOESS Program: 
Inception, Challenges, and 
Divergence 
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Note: The figure on the left is a POES Image of Hurricane Katrina in 2005; the figure on the right is an 
analysis of ozone concentration produced from POES satellite data. 

With the expectation that combining the POES and DMSP programs 
would reduce duplication and result in sizable cost savings, a May 1994 
Presidential Decision Directive required NOAA and DOD to converge the 
two satellite programs into a single satellite program — NPOESS — capable 
of satisfying both civilian and military requirements. 5 The converged 
program, NPOESS, was considered critical to the nation’s ability to 
maintain the continuity of data required for weather forecasting and global 
climate monitoring. NPOESS satellites were expected to replace the 
POES and DMSP satellites in the morning, midmorning, and afternoon 
orbits when they neared the end of their expected life spans. 

To manage this program, DOD, NOAA, and NASA formed a tri-agency 
Integrated Program Office, with NOAA responsible for overall program 
management for the converged system and for satellite operations, the 
Air Force responsible for acquisition, and NASA responsible for facilitating 


5 Presidential Decision Directive NSTC-2, May 5, 1994. 
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the development and incorporation of new technologies into the 
converged system. 

When the primary NPOESS contract was awarded in August 2002, the 
program was estimated to cost about $7 billion through 2018. The 
program was to include the procurement and launch of 6 satellites over 
the life of the program, with each satellite hosting a subset of 13 
instruments. The planned instruments included 1 1 environmental 
sensors, and two systems supporting specific user services (see table 1). 
To reduce the risk involved in developing new technologies and to 
maintain climate data continuity, the program planned to launch the 
demonstration satellite in May 2006. 6 This satellite was intended to 
demonstrate the functionality of selected instruments that would later be 
included on the NPOESS satellites. The first NPOESS satellite was to be 
available for launch in March 2008. 


Table 1: Anticipated NPOESS Instruments, as of July 2002 

Instrument 

Instrument 

type 

Description ^ A, . 

Advanced technology 
microwave sounder 
(ATMS) 

Environmental 

sensor 

Measures microwave energy released and scattered by the atmosphere; to be used in 
combination with the cross-track infrared sounder to produce daily global atmospheric 
temperature, humidity, and pressure profiles. 

Aerosol polarimetry 
sensor 

Environmental 

sensor 

Retrieves specific aerosol (liquid droplets or solid particles suspended in the atmosphere, 
such as sea spray, smog, and smoke) and cloud measurements. 

Conical microwave 
imager/sounder 

Environmental 

sensor 

Collects microwave images and data needed to measure rain rate, ocean surface wind 
speed and direction, amount of water in the clouds, and soil moisture, as well as 
temperature and humidity at different atmospheric levels. 

Cross-track infrared 
sounder (CrIS) 

Environmental 

sensor 

Collects measurements of the infrared radiation emitted and scattered by the Earth and 
atmosphere to determine the vertical distribution of temperature, moisture, and pressure 
in the atmosphere. 

Data collection system 

System 
providing 
services to 
users 

Collects environmental data from platforms around the world and delivers them to users 
worldwide. 

Earth radiation budget 
sensor 

Environmental 

sensor 

Measures solar short-wave radiation and long-wave radiation released by the Earth back 
into space on a worldwide scale to enhance long-term climate studies. 


6 Originally called the NPOESS Preparatory Project, in January 2012, the satellite's name 
was changed to the Suomi National Polar-orbiting Partnership satellite. 
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Instrument 

instrument 

type 

Description 

Global positioning 
system occuitation 
sensor 

Environmental 

sensor 

Measures the refraction of radio wave signals from the Global Positioning System and 
Russia’s Global Navigation Satellite System to characterize the ionosphere and 
information related to the vertical distribution of temperature and moisture of the 
atmosphere. 

Ozone mapper/ profiler 
suite (OMPS) 

Environmental 

sensor 

Collects data needed to measure the amount and distribution of ozone in the Earth's 
atmosphere. Consists of two components (nadir and limb) that can be provided 
separately. 

Radar altimeter 

Environmental 

sensor 

Measures variances in sea surface height/topography and ocean surface roughness, 
which are used to determine sea surface height, significant wave height, and ocean 
surface wind speed and to provide critical inputs to ocean forecasting and climate 
prediction models. 

Search and rescue 
satellite-aided tracking 
system 

System 
providing 
services to 
users 

A subsystem that detects and locates aviators, mariners, and land-based users in 
distress. 

Space environmental 
sensor suite 

Environmental 

sensor 

Collects data to identify, reduce, and predict the effects of space weather on technological 
systems, including satellites and radio links. 

Total and spectral solar 
irradiance sensor 

Environmental 

sensor 

Monitors and captures total and spectral solar irradiance data. 

Visible/infrared imager 
radiometer suite (VIIRS) 

Environmental 

sensor 

Collects images and radiometric data used to provide information on the Earth's clouds, 
atmosphere, ocean, and land surfaces. 


Source: GAO analysis of data from ttie former NPOESS Integrated Program Office 


In the years after the program was initiated, NPOESS encountered 
significant technical challenges in sensor development, program cost 
growth, and schedule delays. By November 2005, we estimated that the 
program’s cost had grown to $10 billion, and the schedule for the first 
launch was delayed by almost 2 years. 7 These issues led to a 2006 
decision to restructure the program, which reduced the program’s 
functionality by decreasing the number of planned satellites from 6 to 4, 
and the number of instruments from 13 to 9. As part of the decision, 
officials decided to reduce the number of orbits from three (early morning, 
midmorning, and afternoon) to two (early morning and afternoon) and to 
rely solely on the European satellites for midmorning orbit data. 

Even after the restructuring, however, the program continued to 
encounter technical issues in developing two sensors, significant tri- 


7 GAO, Polar-orbiting Operational Environmental Satellites: Technical Problems, Cost 
Increases, and Schedule Delays Trigger Need for Difficult Trade-off Decisions, 
GAO-06-249T (Washington, D.C.: Nov. 16, 2005). 
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agency management challenges, schedule delays, and further cost 
increases. Because the schedule delays could lead to satellite data gaps, 
in March 2009 agency executives decided to use S-NPP as an 
operational satellite. 8 Later, in August 2009, faced with costs that were 
expected to reach about $15 billion and launch schedules that were 
delayed by over 5 years, the Executive Office of the President formed a 
task force, led by the Office of Science and Technology Policy, to 
investigate the management and acquisition options that would improve 
the NPOESS program. As a result of this review, in February 2010, the 
Director of the Office of Science and Technology Policy announced that 
NOAA and DOD would no longer jointly procure the NPOESS satellite 
system; instead each agency would plan and acquire its own satellite 
system. 9 Specifically, NOAA would be responsible for the afternoon orbit 
and the observations planned for the first and third satellites. DOD would 
be responsible for the early morning orbit and the observations planned 
for the second and fourth satellites. The partnership with the European 
satellite agencies for the midmorning orbit was to continue as planned. 
When this decision was announced, NOAA and NASA immediately began 
planning for a new satellite program in the afternoon orbit called JPSS. 
DOD began planning for a new satellite program in the morning orbit, 
called the Defense Weather Satellite System, but later decided to 
terminate the program and reassess its requirements, as directed by 
Congress. 


Overview of Initial NOAA 
Plans for the JPSS 
Program 


After the decision was made to disband the NPOESS program in 2010, 
NOAA began the JPSS satellite program. Key plans included: 

• relying on NASA for system acquisition, engineering, and integration; 

• completing, launching, and supporting S-NPP; 

• acquiring and launching two satellites for the afternoon orbit, called 
JPSS-1 and JPSS-2; 

• developing and integrating five sensors on the two satellites; 

• finding alternative host satellites for selected instruments that would 
not be accommodated on the JPSS satellites; and 


8 Using S-NPP as an operational satellite means that the satellite’s data will be used to 
provide climate and weather products. 

9 The announcement accompanied the release of the President’s fiscal year 201 1 budget 
request. 
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• providing ground system support for S-NPP, JPSS, and the Defense 
Weather Satellite System; data communications for MetOp and 
DMSP; and data processing for NOAA’s use of microwave data from 
an international satellite. 

In 2010, NOAA estimated that the life cycle costs of the JPSS program 
would be approximately $11.9 billion for a program lasting through fiscal 
year 2024, which included $2.9 billion in NOAA funds spent on NPOESS 
through fiscal year 201 0. 10 Subsequently, the agency undertook a cost 
estimating exercise where it validated that the cost of the full set of JPSS 
functions from fiscal year 2012 through fiscal year 2028 would be $1 1 .3 
billion. After adding the agency’s sunk costs, which had increased to $3.3 
billion through fiscal year 2011, the program’s life cycle cost estimate 
totaled $14.6 billion. 11 This amount was $2.7 billion higher than the $1 1 .9 
billion estimate for JPSS when NPOESS was disbanded in 2010. 

In working with the Office of Management and Budget to establish the 
president’s fiscal year 2013 budget request, NOAA officials stated that 
they agreed to cap the JPSS life cycle cost at $12.9 billion through 2028, 
to fund JPSS at roughly $900 million per year through 201 7, and to merge 
funding for two climate sensors into the JPSS budget. Because this cap 
was $1.7 billion below the expected $14.6 billion life cycle cost of the full 
program, NOAA decided to remove selected elements from the satellite 
program. Table 2 compares the planned cost, schedule, and scope of 
NOAA’s satellite programs at different points in time. 


10 This figure does not include approximately $2.9 billion in sunk costs that DOD spent on 
NPOESS through fiscal year 2010. 

11 NOAA’s $3.3 billion sunk costs included $2.9 billion through fiscal year 2010 and about 
$400 million in fiscal year 201 1 . 
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Table 2: A Comparison of NPOESS and JPSS, at Different Points in Time 

Key area 

NPOESS program 
: before it was 
restructured {as of 
May 2006) 

NPOESS program after it 
was restructured (as of 
June 2006) 

NPOESS program prior to 
being disbanded (as of 
February 2010) 

JPSS program (as of May 
2010} 

JPSS program (as of 
June 2012) 

Life cycle 
range 

1995-2020 

1995-2026 

1995-2026 

1995-2024 

1995-2028 

Estimated 
life cycle 
cost 

$8.4 billion 

$12.5 billion 

$13.95+ billion* 

$11.9 billion (which includes 
about 52.9 billion spent 
through fiscal year 2010 on 
NPOESS) 

$12.9 billion (which 
includes about $3.3 
billion spent through 
fiscal year 201 1 on 
NPOESS and JPSS) 

Number 

of 

satellites 

6 (in addition to 
S-NPP) 

4 (in addition to S-NPP) 

4 (in addition to S-NPP) 

2 (in addition to S-NPP) 

2 (in addition to S-NPP) 

Number 
of orbits 

3 (early morning, 
mid morning, 
afternoon) 

2 (early morning and 
afternoon; would rely on 
European satellites for 
midmoming orbit data) 

2 (early morning and 
afternoon; would rely on 
European satellites for 
midmoming orbit data) 

1 (afternoon orbit) 

(DOD and European 
satellites would provide early 
and midmoming orbits, 
respectively) 

1 (afternoon orbit) 

(DOD and European 
satellites would provide 
early and midmoming 
orbits, respectively) 

Launch 

schedule 

S-NPP by October 
2006 

First NPOESS (Cl) 
by November 2009 

Second NPOESS 
(C2) by June 2011 

S-NPP by January 2010 

Cl by January 201 3 

C2 by January 2016 

C3 by January 2018 

C4 by January 2020 

S-NPP no earlier than 
September 201 1 

Cl by March 2014 

C2 by May 2016 

C3 by January 2018 

C4 by January 2020 

S-NPP— no earlier than 
September 2011 

JPSS-1 available in 2015 

JPSS-2 available in 2018 

S-NPP— successfully 
launched in October 

2011 

JPSS-1 by March 2017 
JPSS-2 by December 
2022 

Number 

of 

sensors 

1 1 sensors and 2 
user services 
systems 

S-NPP: 4 sensors 

Cl: 6 sensors 

C2: 2 sensors 

C3: 6 sensors 

C4: 2 sensors 

S-NPP: 5 sensors 

Cl: 7 sensors* 

C2: 2 sensors 

C3: 6 sensors 

C4: 2 sensors 

S-NPP: 5 sensors 

JPSS-1: 5 sensors' 

JPSS-2: 5 sensors 

S-NPP: 5 sensors 

JPSS-1 : 5 sensors' 

JPSS-2: 5 sensors 

Free flyer-1: 3 sensors d 
Free flyer-2: 3 sensors 


Source. GAO analysis of NOAA. DOO. and lask force dala. 


“Although the program baseline was $13.95 billion in February 2010, we estimated in June 2009 that 
this cost could grow by about $1 billion. In addition, officials from the Executive Office of the President 
stated that they reviewed life cycle cost estimates from DOD and the NPOESS program office of 
SI 5.1 billion and $16.45 billion, respectively. 

b ln May 2008, the NPOESS Executive Committee approved an additional sensor— the Total and 
Spectral Solar Irradiance Sensor — for the Cl satellite. 

c The five sensors are ATMS, the Clouds and the Earth’s Radiant Energy System (CERES), CrIS, 
OMPS, and VIIRS. NOAA also committed to finding an alternative spacecraft and launch 
accommodation for the Total and Spectral Solar Irradiance Sensor, the Advanced Data Collection 
System, and the Search and Rescue Satellite-Aided Tracking system. 

d NOAA planned to launch two stand-alone satellites, called free flyer satellites, to accommodate the 
Total and Spectral Solar Irradiance Sensor, Search and Rescue Satellite-Aided Tracking system, and 
an Advanced Data Collection System. 
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Prior GAO Work 
Recommended Actions to 
Address the Risk of Gaps 
in Polar Satellite Data 


We have issued a series of reports on the NPOESS and JPSS programs 
highlighting technical issues, cost growth, and key management 
challenges affecting the tri-agency program structure. 12 In June 2012, we 
reported that while NOAA officials communicated publicly and often about 
the risk of a polar satellite data gap, the agency had not established plans 
to mitigate the gap. 13 At the time, NOAA officials stated that the agency 
would continue to use existing satellites as long as they provide data and 
that there were no viable alternatives to the JPSS program. However, our 
report noted that a more comprehensive mitigation plan was essential 
since it is possible that other governmental, commercial, or foreign 
satellites could supplement the polar satellite data. Because it could take 
time to adapt ground systems to receive, process, and disseminate an 
alternative satellite’s data, we noted that any delays in establishing 
mitigation plans could leave the agency little time to leverage its 
alternatives. We recommended that NOAA establish mitigation plans for 
risks associated with pending satellite gaps in the afternoon orbit as well 
as potential gaps in the early morning and midmoming orbits. NOAA 
agreed with the report’s recommendation and noted that the National 
Environmental Satellite, Data, and Information Service — a NOAA 
component agency — had performed analyses on how to mitigate potential 
gaps in satellite data and planned to provide a report by August 2012. 


More recently, in February 2013, we added the potential gap in weather 
satellite data to our biennial High-Risk list. 14 In that report, we noted that 
satellite data gaps in the morning or afternoon polar orbits would lead to 
less accurate and timely weather forecasting; as a result, advanced 
warning of extreme events would be affected. Such extreme events could 
include hurricanes, storm surges, and floods. For example, the National 


12 See, for example, GAO, Polar Satellites: Agencies Need to Address Potential Gaps in 
Weather and Climate Data Coverage, GAO-1 1-945T (Washington, D.C.: Sept. 23, 2011); 
Polar-orbiting Environmental Satellites: Agencies Must Act Quickly to Address Risks That 
Jeopardize the Continuity of Weather and Climate Data, GAO-10-558 (Washington, D C.: 
May 27, 2010); Polar-orbiting Environmental Satellites : With Costs Increasing and Data 
Continuity at Risk, Improvements Needed in Tri-Agency Decision Making, GAO-09-772T 
(Washington, D.C.: June 17, 2009); and Polar-orbiting Environmental Satellites: With 
Costs Increasing and Data Continuity at Risk, Improvements Needed in Tri-Agency 
Decision Making, GAO-09-564 (Washington, DC.: June 17, 2009). 

13 GAO, Polar-orbiting Operational Environmental Satellites: Changing Requirements, 
Technical Issues, and Looming Data Gaps Require Focused Attention, GAO-12-604 
(Washington, D.C.: June 15, 2012). 

14 GAO, High-Risk Series: An Update, GAO-13-283 (Washington, D.C.: February 2013). 
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Weather Service performed case studies to demonstrate how its 
forecasts would have been affected if there were no polar satellite data in 
the afternoon orbit, and noted that its forecasts for the “Snowmaggedon" 
winter storm that hit the Mid-Atlantic coast in February 2010 would have 
predicted a less intense storm further east, with about half of the 
precipitation at 3, 4, and 5 days before the event. Specifically, the models 
would have under-forecasted the amount of snow by at least 10 inches. 
Similarly, a European weather organization 15 recently reported that 
NOAA's forecasts of Hurricane Sandy’s track could have been hundreds 
of miles off without polar-orbiting satellites — rather than identifying the 
New Jersey landfall within 30 miles 4 days before landfall, the models 
would have shown the storm remaining at sea. Such degradation in 
forecasts and warnings would place lives, property, and our nation's 
critical infrastructure in danger. 

We reported that the length of an afternoon polar satellite data gap could 
span from 17 months to 3 years or more. In one scenario, S-NPP would 
last its full expected 5-year life (to October 2016), and JPSS-1 would 
launch as soon as possible (in March 2017) and undergo on-orbit 
checkout for a year (until March 2018). In that case, the data gap would 
extend 17 months. In another scenario, S-NPP would last only 3 years as 
noted by NASA managers concerned with the workmanship of selected 
S-NPP sensors. Assuming that the JPSS-1 launch occurred in March 
2017 and the satellite data were certified for official use by March 2018, 
this gap would extend for 41 months. Of course, any problems with JPSS- 
1 development could delay the launch date and extend the gap period. 
Figure 4 depicts four possible gap scenarios. 


15 The European Centre for Medium Range Weather Forecasts is an independent, 
intergovernmental organization supported by 34 European nations, providing global 
medium-to-extended range forecasts. 
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We also noted that NOAA had recently established a mitigation plan for a 
potential 14- to 18-month gap in the afternoon orbit, which identified and 
prioritized options for obtaining critical observations, including alternative 
satellite data sources and improvements to data assimilation in models 
and listed technical, programmatic, and management steps needed to 
implement these options. However, these plans were only a beginning. 
We suggested that NOAA must make difficult decisions on which steps it 
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would Implement to ensure that its mitigation plans are viable when 
needed, including how these plans would be integrated with the agency’s 
broader end-to-end plans for sustaining weather forecasting capabilities. 


NOAA Has Made 
Progress on JPSS 
Development, but 
Continues to Face 
Challenges in 
Completing S-NPP 
Products, Revising the 
Program’s Scope, and 
Meeting Schedules 


NOAA has made progress towards JPSS program objectives of 
sustaining the continuity of NOAA’s polar-orbiting satellite capabilities 
through the S-NPP, JPSS-1, and JPSS-2 satellites by (1) delivering 
S-NPP data to weather forecasters and (2) by completing significant 
instrument and spacecraft development for the JPSS-1 satellite. 
However, the program is behind schedule in validating the readiness of 
S-NPP products and has experienced delays on the ground system 
schedules for the JPSS-1 satellite. Moreover, the program is moving to 
revise its scope and objectives to reduce costs and prioritize NOAA’s 
weather mission. Until it addresses challenges in product and ground 
system development, the program office may continue to experience 
delays in delivering actionable S-NPP data to users and in meeting 
program development schedules. 


Weather Forecasters Are 
Using Selected S-NPP 
Products, but the JPSS 
Program Is Behind 
Schedule in Validating 
Products and Unaware of 
the Full Extent to Which 
They Are Being Used 


In order to sustain polar-orbiting earth observation capabilities through the 
S-NPP satellite, over the past 18 months the JPSS program had planned 
to complete activation and commissioning of the S-NPP satellite, 
transition the satellite from interim to routine operations, and deliver 76 
data products that were precise enough for use in operational weather 
observations and forecasts. To develop the precise data products, NOAA 
established a process for calibrating and validating its products. Under 
this process, most products (which are primarily sensor data records and 
environmental data records) proceed through three different levels of 
algorithm maturity— the beta, provisional, and validated levels. 16 NOAA 
had originally planned to complete efforts to validate S-NPP products by 
October 2013, which was 2 years after the S-NPP satellite was launched. 
It is not enough, however, to simply deliver validated products. Both the 
Software Engineering Institute and GAO recommend tracking whether 
customers are receiving the expected value from products once they are 


16 According to NOAA and NASA officials, the products go through a beta stage (in which 
products have been minimally validated, but are available to users so that they can begin 
working with the data); a provisional stage (in which products are not optimal, but are 
ready for operational evaluation by users); and a validated stage (in which products are 
ready for operational use). 
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deployed, and whether corrective actions are needed. 17 Moreover, in April 
2013 the Executive Office of the President’s National Science and 
Technology Council released a national strategy for civil earth 
observations that called for agencies to, among other things, track the 
extent to which earth observation data are actually being used, track 
whether the data had an impact, and provide data users a mechanism to 
provide feedback regarding ease of use, suspected quality issues, and 
other aspects of the data. 18 

The JPSS program has made progress on S-NPP since launching the 
satellite in October 2011. Specifically, the program completed satellite 
activation and commissioning in March 2012, and transitioned from 
interim operations under NASA to routine operations under NOAA in 
February 2013. The program also made key upgrades to the ground 
system supporting S-NPP. For example, in November 2012 the office 
completed an interim backup command and control facility that could 
protect the health and safety of the satellite if unexpected issues occurred 
at the primary mission operations facility. In addition, the JPSS program 
office has been working to calibrate and validate S-NPP products in order 
to make them precise enough for use in weather-related operations. 

While the program office plans to have 18 products validated for 
operational use by September 2013, it is behind schedule for the other 
products. Specifically, the program expects to complete validating 35 
S-NPP products by the end of September 2014 and 1 other product by 
the end of September 2015, almost 1 and 2 years later than originally 
planned. In addition, the program office reported that 15 products do not 
need to be validated, one product’s validation date has not been 
established, and 6 products do not have estimated validation dates 
because the program plans to remove them from its requirements. The 
program categorized its products by their priority, ranging from priority-1 
for the highest priority products, to priority-4 for the lowest priority 
products. According to NOAA and NASA officials, the S-NPP products' 
validation has been delayed in part because of issues initially identified on 


17 Software Engineering Institute, CMMI® for Acquisition, Version 1.3 (Pittsburgh, Pa.: 
November 2010) and GAO, Information Technology Investment Management: A 
Framework for Assessing and Improving Process Maturity, Version 1.1, GAO-04-394G 
(Washington, D.C.: March 2004). 

18 Executive Office of the President National Science and Technology Council, National 
Strategy for Civil Earth Observations (Washington, D.C.: April 2013). 
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VIIRS that had to be corrected and additional time needed to validate 
environmental data record products that require observations of seasonal 
weather phenomena. Further, program officials stated that they 
rebaselined the planned product validation timelines in November 2011 
and have been generally meeting the target dates of this revised plan. 
Table 3 illustrates prog ram -re ported data on the number of products in 
each priority level, examples of products, and the estimated validation 
date for the last product at each level. 
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Table 3: Estimated Completion Dates for S-NPP Products, as of July 2013 

Number of f*: 

Priority level (number of 

Examples of products 

Validatedby 

products 

products) 


18 

Priority 1 or 2: 4 

ATMS land surface emissivity 

Advanced Microwave Scanning 
Radiometer-2 sensor data record 

VIIRS polar winds 

VIIRS vegetation fraction 

End of September 2013 


Priority 3 or 4: 14 

ATMS rainfall rate 

OMPS-nadir profile ozone 

OMPS-nadir ozone total column 




Advanced Microwave Scanning 
Radiometer-2 cloud liquid water 


35 

Priority 1 or 2: 5 

ATMS sensor data record 

CrIS sensor data record 

VIIRS sensor data record 

VIIRS imagery 

End of September 2014 


Priority 3 or 4: 29 

OMPS-nadir sensor data record 

VIIRS active fires 

VIIRS cloud optical thickness 

CrIS infrared ozone profile 



No priority: 1 

VIIRS ocean color/chlorophyll 


1 

Priority 3 or 4: 1 

VIIRS vegetation health index suite 

End of September 2015 

15 

Priority not assigned 

Application packets and raw data records 

Not applicable 8 

1 

Priority 1 or 2: 1 

Advanced Microwave Scanning 
Radiometer-2 temperature data record 

Date is still to be determined 

6 

Priority 1 or 2: 0 

Not applicable 

Planned to be removed from 


Priority 3 or 4: 5 

CERES sensor data record 



No priority: 1 

OMPS-limb profiler sensor data record 



Source: GAO analysis of NOAA documents 

Notes: 

‘Program officials stated that selected products, including raw data records and application packets, 
do not undergo validation. 

b Program officials expect that these requirements will be removed once the transfer of instruments is 
approved through the fiscal year 2014 budget process. 

Even though S-NPP products are not at the validated stage in which 
products are ready for operational use, the National Weather Service 
(NWS) has accepted certain products for use in its operational systems. 
For example, the JPSS program office reported that NWS is using ATMS 
temperature data records in its operational forecasts, and that the Alaska 
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Weather Forecast Offices are using VIIRS imagery in its forecasts. In 
addition, NWS’s National Centers for Environmental Prediction is 
evaluating CrlS sensor data records for use in numerical weather 
prediction, but has not yet used the data operationally because it is in the 
midst of a computer upgrade. Officials also stated that the program 
obtains information on the operational use of S-NPP data from other 
NOAA offices, including the National Ocean Service and the National 
Marine and Fisheries Service. 

While NOAA is aware of these uses, it does not track the extent to which 
key satellite data users — including users from the Air Force, Navy, Forest 
Service, European weather offices, and academic institutions — have 
incorporated S-NPP data into their operations or if corrective actions are 
needed to make the products more accurate or more effective for the 
specific users. Program officials noted that they are not required to tailor 
products to meet non-NOAA user requirements, and that they do not 
have a tracking mechanism that would allow them to identify which 
entities are using the data. They noted, however, that the program 
obtains informal reports from customer representatives through various 
working groups and forums, such as the Low-earth Orbiting 
Requirements Working Group and the JPSS Customer Forum. While 
these efforts obtain information from known customer groups, they do not 
meet best practices for actively tracking whether customers are using the 
products, receiving the expected value, or in need of product corrections. 
Until the program office tracks the use of S-NPP and future JPSS 
products, it will not have full knowledge of the extent to which products 
are being used to assess the value they provide to end users and 
whether corrective actions are needed. More significantly, without 
information on who is using S-NPP data, NOAA will be unable to ensure 
that the significant investment made on this satellite is not wasted, 


Development of JPSS 
Flight Project Is on Track, 
but Scheduling Issues on 
the Ground System Have 
Caused Delays 


In order to sustain polar-orbiting earth observation capabilities, the 
program is working to complete development of the JPSS-1 systems in 
preparation for a March 2017 launch date. To manage this initiative, the 
program office organized its responsibilities into two separate projects: (1) 
the flight project, which includes sensors, spacecraft, and launch vehicles 
and (2) the ground project, which includes ground-based data processing 
and command and control systems. Table 4 shows the JPSS projects and 
their key components. 


Page 19 


GAO-13-676 Polar-orbiting Environmental Satellites 



196 


Table 4: JPSS Projects and Components 

Project 

Key components and responsibilities 

Flight 

Sensors: ATMS, CERES, CrIS, OMPS, VilRS 

Spacecraft 

Launch vehicle 

Ground 

Satellite command, control, and communications 

Interface data processing segment 


Source: NOAA's JPSS program office. 


JPSS projects and components are at various stages of system 
development. The flight project has nearly completed instrument 
hardware development for the JPSS-1 satellite and has begun testing 
certain instruments. Also, the flight project completed a major design 
review for the JPSS-1 satellite’s spacecraft. While the flight project’s 
development is on track, the ground project experienced delays in its 
planned schedule that could further delay major program milestones, 
including key reviews required to establish the program’s cost and 
schedule baseline. 

Flight Project: JPSS-1 The fli 9 ht P ro i ect is generally on track with respect to planned JPSS-1 

wtnnnpnt and Srmrprraff instrument and spacecraft development efforts. According to program 

Development Is On Track reports of instrument development, the instruments for the JPSS-1 

satellite are nearly complete. Specifically, as of July 2013, the instrument 
hardware ranged from 80 to 100 percent complete. Also, all of the 
instruments have completed or are scheduled to complete environmental 
testing reviews in 2013 and are to be delivered to the spacecraft by 2014. 
The spacecraft completed its critical design review — which evaluates 
whether the design is appropriately mature to continue with the final 
design and fabrication — in January 2013. 

While individual instruments have experienced delays, the key testing 
milestones and delivery dates for the instruments and spacecraft have 
generally held constant since the last key decision point in July 2012. 
CERES experienced a 10-month slip in its delivery date due to a technical 
issue with the instrument’s internal calibration monitor, and ATMS 
experienced an 8-month slip to its pre-environmentai review due to an 
issue in one of the sensor’s channels, but even accounting for these slips, 
the instruments have a schedule reserve of 14 and 10 months, 
respectively. VI IRS is expected to be the last instrument to be delivered to 
the spacecraft and has a schedule reserve of 6 months. Also, between 
July 2012 and December 2012 instrument contractors’ estimated costs at 
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completion increased by $29 million for ATMS, CrIS, and OMPS, while 
the cost for VIIRS decreased by $46 million. In addition, based on 
program reports of technical performance, the instruments and the 
spacecraft are generally meeting expected technical performance. Table 
5 describes the current status of the components of the JPSS-1 flight 
project. 


Table 5: Status of Key Components of the Flight Project Supporting the JPSS-1 Satellite, as of July 2013 

Component 

Status . . 

Instrument 

ATMS 

The instrument completed its hardware development and is in environmental testing. The instrument experienced a 
technical issue beginning in November 2012 in which science counts in one of the channels were lower than 
expected. The program replaced channel components with spares and performed additional regression testing. This 
issue delayed the planned pre-environmental review by 6 months from November 2012 to May 2013. ATMS is 
expected to be delivered for integration on the spacecraft in March 2014. 

CERES 

The instrument completed its hardware development and is in environmental testing. The instrument’s internal 
calibration monitor exhibited unstable performance during calibration, which delayed its delivery by 13 months. The 
cause of this issue is still unknown. CERES underwent pre-environmental review in February 2012. The program 
office plans to perform additional calibration testing, vacuum performance testing, and regression testing prior to its 
delivery in October 2013. 

CrIS 

The instrument completed 80 percent of its hardware development and is in subsystem integration. The 
instrument's electronic components have been experiencing a power-up issue, possibly due to a timing issue with 
the digital power supply. The program office replaced the power supply with a spare and is working on resolving the 
issue and completing acceptance testing. Additional work remaining on the instrument includes completing the 
subsystems, integrating the complete instrument, conducting the pre-environmental review in September 2013, and 
completing its environmental test program. The expected delivery date for the instrument is August 2014. 

OMPS-Nadir 

The instrument completed its hardware development and is in environmental testing. The instrument’s diffuser 
experienced degradation during calibration and the adhesive was deemed the root cause. There was no 
performance impact but the instrument's delivery date slipped 3 months. The program office planned to complete 
cleaning, regression testing, and preparation of the nadir unit for testing. The instrument completed a pre- 
environmental review in April 2013, is conducting environmental testing, and is expected to be delivered in August 
2014. 

VIIRS 

The instrument completed 80 percent of its hardware development and is in subsystem integration. Several sensor 
components have been delivered, installed, and integrated. VIIRS is expected to undergo pre-environmental review 
in October 2013 with an expected delivery in October 2014. 

Spacecraft 

The spacecraft completed its critical design review in December 2012; hardware development is ongoing. The 
spacecraft has an expected delivery in October 2014. 

Launch vehicle 

NASA awarded a contract for launch services in July 2012. Previously accepted risks for the launch program on 
S-NPP are being reviewed for applicability and potential mitigation. 


Source: GAO analysis of JPSS program office data. 


Ground Project: Progress The JPSS ground project has made progress in developing the ground 

Made, but Facility Scheduling system components, but scheduling issues have caused delays in the 
Problems Have Caused Delays deployment of system upgrades. Specifically, between August 2012 and 
February 2013, the program office defined the ground system’s technical 
performance baseline, ordered and received the first increment of 
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hardware for the next major software release, and transitioned S-NPP 
operational management from the JPSS program to NOAA’s office 
responsible for satellite operations. 

However, the program has delayed the delivery of key ground system 
upgrades needed to support JPSS-1 because the facilities needed for 
hardware installation, software development, and testing activities were 
not available when needed. The ground system upgrades, called block 
1.5 and 2.0, were originally scheduled to be delivered in January and 
December 2015, respectively. To address the problem in scheduling the 
facilities, NOAA delayed the delivery of block 1.5 and merged it with block 
2.0. The program is now expecting to deliver both upgrades in December 
2015. We have previously reported that compressing system 
development schedules introduces program risk because it implies the 
need to accomplish a larger number of activities in parallel and on time 
before the next major event can occur as planned. 19 As a result, any 
complications in the merged ground system upgrades could affect the 
system’s readiness to support the JPSS-1 launch date. 


NOAA Revised Program 
Scope to Focus on 
Weather Priorities and 
Reduce Costs 


While NOAA is moving forward to complete product development on the 
S-NPP satellite and system development on the JPSS-1 satellite, the 
agency recently made major revisions to the program’s scope and 
planned capabilities and is moving to implement other scope changes as 
it finalizes its plans pending congressional approval. We previously 
reported that, as part of its fiscal year 201 3 budget process, NOAA was 
considering removing selected elements of the program in order to 
reduce total program costs from $14.6 billion to $12.9 billion. 20 By October 
2012, NOAA made the following changes in the program’s scope: 

• develop two (instead of three) TSIS instruments as well as two free- 
flyer spacecraft and launch vehicles to accommodate the instruments; 

• reduce the previously planned network of fifteen ground-based 
receptor stations to two receptor sites at the north pole and two sites 
at the south pole; 


19 See GAO-12-120G {exposure draft). 

20 GAO-12-604. 
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• increase the time it takes to obtain satellite data and deliver it to the 
end user from 30 minutes to 80 minutes on the JPSS-2 satellite; 21 

• not install an interface data processing segment at the two Navy 
locations or at the Air Force Weather Agency; and 

• withdraw future support for ground operations for DOD’s Defense 
Weather Satellite System, which was subsequently cancelled. 

More recently, as proposed by the administration, NOAA began 
implementing additional changes in the program’s scope and objectives in 
order to meet the agency’s highest-priority needs for weather forecasting 
and reduce program costs from $12.9 billion to $11.3 billion. Specifically, 
NOAA has begun to: 

• Transfer requirements for building the OMPS-limb and CERES follow- 
on climate sensors for the JPSS-2 satellite to NASA. 

• Transfer the first free-flyer mission from the JPSS program to a 
separate NOAA program, called the Polar Free Flyer program, and 
cancel the second free-flyer mission. More information on the Polar 
Free Flyer program is provided in appendix II. 

• Eliminate requirements for a legacy type of broadcast transmitter, 
which, according to NOAA officials, is in a spectrum range being 
crowded out by terrestrial users and is consistent with its European 
partners’ plans. 

• Reduce science and algorithm requirements for lower-priority data 
products. 

• Reduce operations and sustainment costs based on increased 
efficiencies through moving from customized components to more off- 
the-shelf solutions. 

• Reduce the mission life cycle by 3 years from 2028 to 2025. 

While we were unable to precisely itemize the reductions in costs 
associated with various program changes, program officials provided 
rough estimates. The following table summarizes the reported cost 
reductions associated with key changes to the JPSS program. 


21 in January 2013, program officials revised this delay to 96 minutes to more precisely 
reflect the time it takes to send products from the ground system to the end users. 
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Table 6; Reported Cost Reductions Associated with JPSS Changes 

Timing of revisions 

Program reported cost 
reductions 

Major scope changes and other revisions 

June 2012 

$1 .7 billion through 2028 
(from the $14.6 billion to $12.9 
billion life cycle cost estimates) 

Restructured free flyer missions ($800 M) 

Revised operations and sustainment concept ($700M) 

Reduced reserve estimates ($200M) 

April 2013 

$1.6 billion through 2025 
(from the $12.9 billion to $11.3 
billion life cycle cost estimates) 

Transferred first free flyer mission to Polar Free Flyer program and 
transferred a TSIS, CERES, and OMPS-Limb instrument to NASA 
($750M) 

Reduced program lifetime by 3 years, from 2028 to 2025 ($390M) 
Eliminated second free-flyer mission and one type of communication 
downlink ($240 M) 

Lowered expected costs for the JPSS-1 launch vehicle and launch 
services ($9M) 

Saved in other areas, including costs saved by acquiring VilRS spare 
parts from the Air Force and eliminating enhanced data processing of 
data obtained from the Global Change Observation Mission-Water 
satellite ($21 1M) 


Source: GAO analysis of JPSS program data. 


While there are a number of reasons for individual changes in the 
program, the key reason for the June 2012 changes was to meet the 
program’s $12.9 billion cost cap. The reasons for the more recent 
changes were to reduce mission costs and complexity, focus JPSS 
priorities on NOAA’s weather forecasting mission, and identify 
opportunities to reduce potential gaps between JPSS satellites, all of 
which an independent study on NOAA’s satellite program recommended 
in July 2012. 

While these are worthy goals, the changes NOAA implemented over the 
last 2 years will have an impact on those who rely on polar satellite data. 
Specifically, satellite data products will be delivered more slowly than 
anticipated because of the reduction in the number of ground stations, 
and military users may not obtain the variety of products once anticipated 
at the rates anticipated because of the removal of their ground-based 
processing subsystems. Further, while not as obvious, the impact of other 
changes, including the removal of the communications downlink and the 
reduction of requirements for certain algorithms, could also affect specific 
groups of satellite data users. As NOAA moves to implement these 
program changes, it will be important to assess and understand the 
impact the changes will have on satellite data users. 
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JPSS Schedules 
Demonstrate Multiple 
Best Scheduling 
Practices, but 
Integration Problems 
and Other 

Weaknesses Reduce 
Confidence in the 
JPSS-1 Launch Date 


The JPSS program office has established a preliminary integrated master 
schedule and implemented multiple scheduling best practices, but the 
integrated master schedule is not complete and weaknesses in 
component schedules significantly reduce the program’s schedule quality 
as well as management’s ability to monitor, manage, and forecast satellite 
launch dates. The incomplete integrated master schedule and shortfalls in 
component schedules are due in part to the program’s plans to further 
refine the schedule as well as schedule management and reporting 
requirements that varied among contractors. Further, while the program is 
reporting a 70 percent confidence level in the JPSS-1 launch date, its 
analysis is likely to be overly optimistic because it was not conducted with 
an integrated schedule and included a component schedule with 
weaknesses. Until the program office completes its integrated master 
schedule and addresses weaknesses in component schedules, it will lack 
the information it needs to effectively monitor development progress, 
manage dependencies between schedules, and forecast the JPSS-1 
satellite’s completion and launch. 


The JPSS Program Has Not 
Yet Established a 
Complete Integrated 
Master Schedule 


According to our guidance on best practices in scheduling, 22 the success 
of a program depends in part on having an integrated and reliable master 
schedule that defines when and how long work will occur and how each 
activity is related to the others. The program schedule provides not only a 
road map for systematic project execution but also the means by which to 
gauge progress, identify and resolve potential problems, and promote 
accountability at all levels of the program. An integrated master schedule 
constitutes a program schedule as a network of logically linked 
sequences of activities that includes the entire required scope of effort, 
including the effort necessary from the government, contractors, and 
other key parties for a program’s successful execution from start to finish. 
Although the integrated master schedule includes all government, 
contractor, and external effort, the government program management 
office is ultimately responsible for its development and maintenance. 


The JPSS program office provided a preliminary integrated master 
schedule in June 201 3, but this schedule is incomplete. The program’s 
June 2013 schedule is its first attempt to document a programwide 
integrated master schedule since it began in October 2010. The schedule 


22 GAO-12-120G (exposure draft). 
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contains the scope of work for key program components, such as the 
JPSS-1 and JPSS-2 satellites and the ground system, and cites linkages 
to more detailed component schedules. However, significant weaknesses 
exist in the program’s schedule. Specifically, about one-third of the 
schedule is missing logical relationships called dependencies that are 
needed to depict the sequence in which activities occur. Because a logic 
relationship dictates the effect of an on-time, delayed, or accelerated 
activity on subsequent activities, any missing or incorrect logic 
relationship is potentially damaging to the entire network. Complete 
network logic between all activities is essential if the schedule is to 
correctly forecast the start and end dates of activities within the plan. 
Program documentation acknowledges that this schedule is not yet 
complete and the program office plans to refine it over time. Until the 
program office completes its integrated schedule and includes logically 
linked sequences of activities, it will lack the information it needs to 
effectively monitor development progress, manage dependencies, and 
forecast the JPSS-1 satellite’s completion and launch. 


The Quality of JPSS-1 
Component Schedules Is 
Inconsistent 


Our scheduling guidance identifies ten best practices that support four 
characteristics of a high-quality, reliable schedule — comprehensive, well- 
constructed, credible, and controlled. 23 A comprehensive schedule 
includes all government and contractor activities, reflects resources 
(labor, materials, and overhead) needed to do the work, and realistically 
reflects how long each activity will take. A well-constructed schedule 
includes activities that are sequenced with the most straightforward logic 
possible, a critical path 24 that represents a true model of the activities that 
drive the project’s earliest completion date, and total float that accurately 
depicts schedule flexibility. A credible schedule reflects the order of 
events necessary to achieve aggregated products or outcomes 
(horizontal traceability) and maps varying levels of the schedule to one 
another (vertical traceability). Also, a credible schedule includes data 
about risks and opportunities that are used to predict a level of confidence 
in meeting the project’s completion date. A controlled schedule is updated 
periodically by trained schedulers using actual progress and logic to 


23 GAO-12-120G (exposure draft). 

24 The critical path is generally defined as the longest continuous sequence of activities in 
a schedule. As such, it defines the program's earliest completion date or minimum 
duration. 
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realistically forecast dates for program activities and is compared against 
a designated baseline schedule to measure, monitor, and report the 
project's progress. The JPSS program office is applying NASA’s schedule 
management handbook guidance to manage its schedules, which is 
largely consistent with our guidance on scheduling best practices. Table 7 
provides more detail on the best practices and key characteristics of a 
reliable schedule. 


Table 7: The Four Characteristics and Ten Best Practices of a High-Quality and Reliable Schedule 


Characteristic 

Best practice 

Description 

Comprehensive 

Capturing all activities 

The schedule should reflect all activities as defined in the project's work breakdown 
structure, which defines in detail the work necessary to accomplish a project's 
objectives, including activities both the owner and contractors are to perform. 


Assigning resources to all 
activities 

The schedule should reflect the resources (labor, materials, overhead) needed to do the 
work, whether they will be available when needed, and any funding or time constraints. 


Establishing the duration of 
all activities 

The schedule should realistically reflect how long each activity will take. When the 
duration of each activity is determined, the same rationale, historical data, and 
assumptions used for cost estimating should be used. Durations should be reasonably 
short and meaningful and allow for discrete progress measurement. Schedules that 
contain planning and summary planning packages as activities will normally reflect 
longer durations until broken into work packages or specific activities. 

Well- 

constructed 

Sequencing all activities 

The schedule should be planned so that critical project dates can be met. To do this, 
activities need to be logically sequenced— that is, listed in the order in which they are to 
be carried out. In particular, activities that must be completed before other activities can 
begin (predecessor activities), as well as activities that cannot begin until other activities 
are completed (successor activities), should be identified. Date constraints and lags 
should be minimized and justified. This helps ensure that the interdependence of 
activities that collectively lead to the completion of events or milestones can be 
established and used to guide work and measure progress. 


Confirming that the critical 
path is valid 

The schedule should identify the program critical path— the path of longest duration 
through the sequence of activities. Establishing a valid critical path is necessary for 
examining the effects of any activity’s slipping along this path. The program critical path 
determines the program's earliest completion date and focuses the team’s energy and 
management's attention on the activities that will lead to the project’s success. 


Ensuring reasonable total 
float 

The schedule should identify reasonable float (or slack)— the amount of time by which a 
predecessor activity can slip before the delay affects the program’s estimated finish 
date— so that the schedule’s flexibility can be determined. Large total float on an activity 
or path indicates that the activity or path can be delayed without jeopardizing the finish 
date. The length of delay that can be accommodated without the finish date’s slipping 
depends on a variety of factors, including the number of date constraints within the 
schedule and the amount of uncertainty in the duration estimates, but the activity’s total 
float provides a reasonable estimate of this value. As a general rule, activities along the 
critical path have the least float. 
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Characteristic 

Best practice 

Description 

Credible 

Verifying that the schedule 
can be traced horizontally 
and vertically 

The detailed schedule should be horizontally traceable, meaning that it should link 
products and outcomes associated with other sequenced activities. These links are 
commonly referred to as “handoffs” and serve to verify that activities are arranged in the 
right order for achieving aggregated products or outcomes. The integrated master 
schedule should also be vertically traceable — that is, varying levels of activities and 
supporting subactivities can be traced. Such mapping or alignment of levels enables 
different groups to work to the same master schedule. 


Conducting a schedule risk 
analysis 

A schedule risk analysis uses a good critical path method schedule and data about 
project schedule risks and opportunities as well as statistical simulation to predict the 
level of confidence in meeting a program's completion date, determine the time 
contingency needed for a level of confidence, and identify high-priority risks and 
opportunities. As a result, the baseline schedule should include a buffer or reserve of 
extra time. 

Controlled 

Updating the schedule 
using actual progress and 
logic 

Progress updates and logic provide a realistic forecast of start and completion dates for 
program activities. Maintaining the integrity of the schedule logic at regular intervals is 
necessary to reflect the true status of the program. To ensure that the schedule is 
properly updated, people responsible for the updating should be trained in critical path 
method scheduling. 


Maintaining a baseline 
schedule 

A baseline schedule is the basis for managing the project scope, the time period for 
accomplishing it, and the required resources. The baseline schedule is designated the 
target schedule, subject to a configuration management control process, against which 
project performance can be measured, monitored, and reported. The schedule should 
be continually monitored so as to reveal when forecasted completion dates differ from 
planned dates and whether schedule variances will affect downstream work. A 
corresponding baseline document explains the overall approach to the project, defines 
custom fields in the schedule file, details ground rules and assumptions used in 
developing the schedule, and justifies constraints, lags, long activity durations, and any 
other unique features of the schedule. 


Source: GAO Schedule Assessment Guide, GAO-1 2-1 20G (exposure draft). 


The quality of three selected component schedules supporting the JPSS- 
1 mission — VIIRS, the spacecraft, and the ground system— was 
inconsistent with respect to implementing the characteristics of a high- 
quality, reliable schedule. 25 Each schedule had strengths and 
weaknesses with respect to sound scheduling practices, but VIIRS was a 
stronger schedule with fewer weaknesses compared to the ground 
system and spacecraft schedules. Since the reliability of an integrated 
schedule depends in part on the reliability of its subordinate schedules, 
schedule quality weaknesses in these schedules could transfer to an IMS 
derived from them. Table 8 identifies the quality of each of the selected 
JPSS-1 component schedules based on the extent to which they met ten 


25 These three component schedules represent the critical path for the flight project and 
the entire ground system schedule. 
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best practices of high-quality and reliable schedules; the discussion that 
follows highlights observed strengths and weaknesses from each 
schedule. In addition, appendix Mi includes a more detailed assessment of 
each schedule against the ten best practices. 


Table 8: Assessment of JPSS-1 Component Schedule Quality 

.Schedule characteristic or best practice 


v ; - Ground system 

Spacecraft 

VI IRS j 

Comprehensive 

Capturing ail activities 


3 

3 

3 

Assigning resources to all activities 


3 

3 

3 

Establishing the duration of ail activities 


3 

3 

• 

Well-constructed 

s>.. -."'Wf;... 




Sequencing ail activities 


3 

3 

3 

Confirming that the critical path is valid 


O 

3 

3 

Ensuring reasonable total float 


3 

3 

3 

Credible "Xxgj,;. - . 

Verifying that the schedule can be traced horizontally and vertically 

3 

3 

9 

Conducting a schedule risk analysis 


O 

3 

3 

Controlled 





Updating the schedule using actual progress and logic 

9 

• 

• 

Maintaining a baseline schedule 


3 

a 

3 


Source: GAO analysis of detailed schedules and related documentation tor the VI IRS instrument, spacecraft, and ground system. 

• = Met: The program office or contractor provided complete evidence that satisfies the entire 
criterion. 

9 = Substantially met: The program office or contractor provided evidence that satisfies a large 
portion of the criterion. 

d = partially met: The program office or contractor provided evidence that satisfies about half of the 
criterion. 

(5 = Minimally met: The program office or contractor provided evidence that satisfies a small portion 
of the criterion. 

O = Not met: The program office or contractor provided no evidence that satisfies any of the criterion. 

Ground Schedule 

Of the ten best practices, the ground system schedule minimally met two 
best practices, partially met two best practices, and substantially met six 
best practices. There were strengths in the ground schedule in that the 
contractor established a clear process for integrated information between 
the schedule and its resource management software and the contractor 
has performed resource leveling on the schedule, in addition, the 
contractor stated that people responsible for the activities estimated 
activity durations. Also, the contractor stated that it performs wellness 
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checks on the quality of the schedule after each update to identify issues 
associated with missing logic or date constraints and provides a monthly 
status briefing to the JPSS program office that addresses the status of 
external schedule handoffs. 

However, there were also weaknesses in the ground schedule. For 
example, activities on the critical path with date constraints are preventing 
accurate calculations of the schedule’s total float, or flexibility. In order for 
the critical path to be valid, the activities on the critical path must also 
have reasonable total float. Without a critical path that accurately 
calculates schedule flexibility, the program office will not be able to 
provide reliable timeline estimates or identify when problems or changes 
may occur and their effect on downstream work. Moreover, while the 
contractor conducted a schedule risk analysis on the schedule, that 
analysis was for select near-term milestones rather than the readiness of 
the ground system for the launch of JPSS-1 and it did not include the 
risks most likely to delay the project. A schedule risk analysis should be 
conducted through the finish milestone and should include risk data to 
determine activities that most often end up on the critical path. 

Spacecraft Schedule Of the ten best practices, the spacecraft schedule partially met eight best 

practices, and substantially met two best practices. There were strengths 
in the spacecraft schedule in that it was horizontally and vertically 
traceable; the contractor provided evidence of monthly progress updates 
to management, including status reporting of key milestones, handoffs, 
explanations of date changes, and an analysis of the critical and near- 
critical paths; the contractor conducted a schedule risk analysis; and the 
schedule included baseline dates of activities for comparisons of actual 
performance to date. 

However, there were also weaknesses in the spacecraft schedule. For 
example, the schedule had a low level of detail and included one-third of 
remaining activities with durations greater than 44 days, even after 
accounting for undefined and procurement-related activities. When 
establishing the durations of activities, they should be reasonably short 
and meaningful and allow for discrete progress measurement. Durations 
longer than 2 months do not facilitate objective measurement of 
accomplished effort and the milestone to detail activity ratio does not 
allow for effective progress measurement and reporting. As another 
example of a quality shortfall, the schedule was overly flexible with high 
float values that were not justified in schedule documentation. 

Specifically, 70 percent of remaining activities had about 5 business 
weeks of float, including 67 activities that had over 1,000 days of float, 
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meaning that these activities could slip approximately 3.5 years without 
affecting the project’s completion date. In order to establish reasonable 
total float, there should be documented justification for high float values in 
the schedule. Without this, it is unclear whether float values are high due 
to factors accepted by management and which are due to incomplete 
logic or other issues. 

VIIRS Schedule The VJIRS schedule partially met one best practice, substantially met 

seven best practices, and fully met two best practices. There were 
strengths in the VIIRS schedule in that the contractor established a clear 
process for integrating information between the schedule and resource 
management software, stated that durations were estimated by the 
people responsible for the activities based on work to be done, and 
justified in its schedule documentation activities with durations longer than 
44 days. In addition, the contractor justified in schedule documentation 
the use of all date constraints, identified a valid driving path of activities 
for managing the program, and identified reasonable float values or 
justified them to the JPSS program office. Further, the contractor provided 
a schedule narrative accompanying each status update, which describes 
the status of key milestone dates (including the program finish date); 
explanations for changes in key dates; and a description of critical paths. 

However, there were also weaknesses in the VIIRS schedule. For 
example, the schedule had milestones that represented handoffs 
between contractor integrated product teams, but it did not include 
handoffs to the JPSS program office. In order to verify a schedule’s 
horizontal traceability, handoffs should link products and outcomes 
associated with other sequenced activities. Without this, there could be 
different expectations between management and activity owners. As 
another example, the contractor conducted a schedule risk analysis with 
a good schedule network and obtained three different duration estimates 
from subject matter experts. However, the duration estimates did not 
reflect risks from the project’s risk register and the analysis was focused 
only on activities on the critical path. This approach is flawed because 
activities that are not currently on the critical path could become critical as 
risks occur. 
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The inconsistency in quality among the three schedules has multiple 
causes. Program and contractor officials explained that certain 
weaknesses have been corrected with updated schedules. In other 
cases, the weaknesses lacked documented explanation in part because 
the JPSS program office did not require contractors to provide such 
documentation. Based on program schedule documentation, the schedule 
management and reporting requirements varied across contractors 
without documented justification for tailored approaches, which may 
partially explain the inconsistency in practices among the schedules. 

Since the reliability of an integrated schedule depends in part on the 
reliability of its subordinate schedules, schedule quality weaknesses in 
these schedules will transfer to an integrated master schedule derived 
from them. Consequently, the extent to which there are quality 
weaknesses in JPSS-1 support schedules further constrains the 
program’s ability to monitor progress, manage key dependencies, and 
forecast completion dates. Until the program office addresses the 
scheduling shortfalls in its component schedules, the JPSS schedule will 
have lower quality and reduced reliability as a management tool for 
monitoring and forecasting satellite launch dates. 


Program Has Confidence 
in the JPSS-1 Schedule, but 
Its Assumptions Do Not 
Reflect Weaknesses in the 
Underlying Data 


According to our guidance on best practices in scheduling, ZB a schedule 
risk analysis uses statistical techniques to predict a level of confidence in 
meeting a program’s completion date. This analysis focuses on key risks 
and how they affect the schedule's activities. The analysis does not focus 
solely on the critical path because, with risk considered, any activity may 
potentially affect the program’s completion date. By relying on statistical 
simulations to randomly vary activity durations according to the probability 
of occurrence for certain durations and risks, the analysis seeks to 
develop a probability distribution of possible completion dates that reflect 
the program plan and enable an organization to match a date to its 
degree of risk tolerance. 


The JPSS program office has conducted a schedule risk analysis on the 
JPSS-1 mission schedule (and launch date) through NASA’s joint cost 


26 GAO-12-120G (exposure draft). 
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and schedule confidence level (JCL) process. 27 The JCL implemented by 
the JPSS program office represents a best practice In schedule 
management for establishing a credible schedule and reflects a robust 
schedule risk analysis conducted on key JPSS-1 schedule components. 
For example, the analysis assessed the impacts of key risks from the risk 
register and how multiple duration estimates for activities, based on 
documented uncertainty distributions, could affect the schedule. Based on 
the results of the JCL, the program office reports that its level of 
confidence in the JPSS-1 schedule is 70 percent and that it has sufficient 
schedule reserve to maintain a launch date of no later than March 2017. 

However, the program office’s level of confidence in the JPSS-1 schedule 
may be overly optimistic for two key reasons. First, the model that the 
program office used was based on flight project activities rather than an 
integrated schedule consisting of flight, ground, program office, and other 
activities relevant to the development and launch of JPSS-1. As a result, 
the JPSS program office’s confidence level projections do not factor in the 
ongoing scheduling issues that are impacting the ground project. Had 
those issues been considered, the JPSS-1 confidence level would have 
been lower. Second, there are concerns regarding the spacecraft 
schedule’s quality as discussed in the previous section. Factoring in these 
concerns, the confidence of the JPSS-1 satellite’s schedule and projected 
launch date would be lower. We have previously reported that when using 
the JCL, NASA projects did not always include relevant cost and risk 
inputs. 28 

While program officials noted that they included key ground system risks 
In their calculations, they did not include ground system scope in the JCL 
because it was too difficult to allocate ground system components to 
individual missions. Moreover, officials stated that they do not plan to 
include ground project or program office activities in future JCL updates. 
While it may have been difficult to include ground system scope in the 
JCL, without this, the program’s schedule risk analysis and JCL do not 
reflect the full amount of work to be performed leading to JPSS-1 launch. 


21 The JCL is a probabilistic analysis that includes, among other things, ai! cost and 
schedule elements, incorporates and quantifies potential risks, assesses the impacts of 
cost and schedule to date, and addresses available annual resources to arrive at 
development cost and schedule estimates associated with various confidence levels. 

28 GAO, NASA: Assessments of Selected Large-Scale Projects, GAO- 1 2-207 SP 
(Washington, D.C.: March 1, 2012). 
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Until the program office conducts a schedule risk analysis on an 
integrated schedule that includes the entire scope of effort and addresses 
quality shortfalls of relevant component schedules, it will have less 
assurance of meeting the planned March 2017 launch date for JPSS-1 . 


NOAA Has Analyzed 
Alternatives for 
Addressing Gaps in 
Satellite Data, but 
Lacks a 

Comprehensive 
Contingency Plan 


While NOAA has identified multiple ways to help mitigate expected gaps 
in polar satellite data, it has not yet developed and implemented a 
comprehensive contingency plan. In October 2012, NOAA established a 
plan to address the impact of potential gaps in polar afternoon satellite 
data and contracted for a technical assessment that generated additional 
alternatives for the agency to consider. However, NOAA’s mitigation plan 
has shortfalls when compared to government and industry best practices. 
Moreover, NOAA intends to update its plan by fall 2013 by integrating 
alternatives generated from the contractor’s technical assessment. Until 
NOAA establishes a comprehensive contingency plan that addresses key 
shortfalls, it may not be positioned to effectively mitigate anticipated gaps 
In polar satellite coverage. 


NOAA Identified Multiple 
Ways to Mitigate Polar 
Satellite Data Gaps 


Polar satellites are essential to NOAA’s mission to understand and predict 
changes in climate, weather, oceans, and coasts. Satellite data gaps in 
the morning or afternoon polar orbits would lead to less accurate and 
timely weather forecasting; as a result, advanced warning of extreme 
events would be affected. In June 2012, we reported that while NOAA 
officials communicated publicly and often about the risk of a polar satellite 
data gap, the agency had not established plans to mitigate the gap. 29 We 
recommended that NOAA establish mitigation plans for pending satellite 
gaps in the afternoon orbit as well as potential gaps in the early morning 
and midmorning orbits and NOAA agreed with the report's 
recommendation. 

In October 2012, NOAA established a mitigation plan to address the 
impact of potential gaps in polar afternoon satellite data. This plan 
identifies alternatives for mitigating the risk of a 14- to 18-month gap in 
the afternoon orbit beginning in March 2016, between the current polar 
satellite and the JPSS-1 satellite. Key alternatives include utilizing 
different satellites as data sources and Improving data assimilation in 
models. The plan also lists technical, programmatic, and management 


29 GAO-12-604. 


Page 34 


GAO-13-676 Polar-orbiting Environmental Satellites 





211 


actions needed to implement these options. Table 9 provides an overview 
of NOAA's polar satellite gap mitigation plan. 


Table 9: Summary of NOAA’s Polar Satellite Gap Mitigation Plan 


Key assumptions 

There would be a polar afternoon 
gap of 14 to 18 months between 
March 2016 and October 2017 
(the date that JPSS-1 is to 
become operational) 

Mission critical data from 
S-NPP’s ATMS, CrIS, and VIIRS 
instruments would be lost 

DOD and European satellites 
would continue providing data in 
the early morning and 
midmorning orbits, respectively 


Key actions 

Technical: 


Alternatives 

Use similar data from available 
sources, such as existing DOD. 
NOAA, and NASA polar satellites 

Improve NOAA data assimilation 

Rely on foreign data, including 
radio occultation data or future 
polar satellites from other nations 
such as Russia or China 

Use non-satellite sources, such as 
aircraft observations 

Use commercial solutions (although 
none were identified) 


. Conduct data denial experiments 
eliminating afternoon polar-orbiting 
sounder data from forecast models 

. Calculate, obtain, and distribute the 
estimated end-of-life of all sounder 
and imagery satellite assets 

Programmatic: 

. Monitor and report monthly on the 
health of instruments on existing 
polar satellites 

• Augment NOAA research and 
development computing capability 
as soon as possible to run data 
impact experiments 

Management: 

• Commit to augmenting NOAA 
operational computing capability 

• Maintain international relationships 
that can result in partnerships for 
satellite data 


Implementation 

status 

Actions were not 
implemented or 
funded. 


Source; GAO analysis of NOAA data. 


However, NOAA did not implement the actions identified in its mitigation 
plan and decided to identify additional alternatives. In October 2012, at 
the direction of the Under Secretary of Commerce for Oceans and 
Atmosphere (who is also the NOAA Administrator), NOAA contracted for 
a detailed technical assessment of alternatives to mitigate the 
degradation of products caused by a gap in satellite data in the afternoon 
polar orbit. This assessment solicited input from experts within and 
outside of NOAA and resulted in the following alternatives: 

• rely on DOD’s DMSP satellite; 

• expand the use of radio occultation data, including funding the ground 
segment for a follow-on United States/Taiwan radio occultation 
mission; 

• use atmospheric motion vectors (observed wind data); 
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• utilize future geostationary advanced imagery data; 

• expand the use of aircraft observations; 

• expand the use of targeted observations for high-impact events; 

• implement a 4-dimensional hybrid data assimilation system (by adding 
a time dimension) ; 

• improve data assimilation of cloud-impacted radiances; 

• implement blends of global models, such as European and Canadian 
models; 

• accelerate global model research to operations; 

• sustain the use of high-latitude direct readout imagery; and 

• rely on China’s future Feng Yun-3 satellite. 

Moving forward, NOAA officials stated that they are currently considering 
the additional alternatives and that the agency intends to integrate a final 
set of alternatives into its existing mitigation plan by the fall of 2013. 


NOAA Does Not Yet Have 
a Comprehensive 
Contingency Plan 


Government and industry best practices call for the development of 
contingency plans to maintain an organization’s essential functions in the 
case of an adverse event. 30 As a complement to risk mitigation, 
contingency planning includes strategies that attempt to reduce or control 
the impact of risks should they occur. These practices identified by, for 
example, the National Institute of Standards and Technology and the 
Software Engineering Institute, include key elements such as defining 
failure scenarios, identifying and selecting strategies to address failure 
scenarios, developing procedures and actions to implement the selected 
strategies, testing the plans, and involving affected stakeholders. These 
elements can be grouped into categories, including (1) identifying failure 
scenarios and impacts, (2) developing contingency plans, and (3) 
validating and implementing contingency plans (see table 10). 


30 See GAO, Year 2000 Computing Crisis: Business Continuity and Contingency 
Planning, GAO/AIMD-IO.1.19 (Washington, D.C.: August 1998); National Institute of 
Standards and Technology, Contingency Planning Guide for Federal Information Systems, 
NIST 800-34 (May 2010); Software Engineering Institute, CMMI® for Acquisition, Version 
1.3 (Pittsburgh, Pa.: November 2010). 
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Table 10: Guidelines for Developing a Sound Contingency Plan 

Category ?:• 

Description 

Identifying failure 
scenarios and impacts 

This category includes activities such as defining failure scenarios, conducting impact analyses that show 
the impact of failure scenarios; defining minimum acceptable levels of outputs and recovery time 
objectives; and establishing resumption priorities. 

Developing contingency 
plans 

This category includes activities such as identifying aiternative solutions to address failure scenarios; 
selecting contingency strategies from among alternatives based on costs, benefits, and impacts; defining 
actions, roles and responsibilities, triggers, and timelines for implementing contingency plans; developing 
“zero-day” procedures; ensuring that steps reflect priorities for resumption of products and recovery 
objectives; and obtaining review and approval of the contingency plan from designated officials. 

Validating and 
implementing 
contingency plans 

This category indudes activities such as identifying steps for testing contingency plans and conducting 
training exercises; preparing for and executing tests; validating test results for consistency against 
minimum performance levels; executing applicable actions for implementation of contingency strategies; 
communicating and coordinating with stakeholders to ensure that contingency strategies remain optimal for 
reducing potential impacts; and updating and maintaining contingency plans as warranted. 


Source: GAO analysis of guidance documents from the National Institute of Standards and Technology, Software Engineering Institute, 
and GAO 


By documenting its mitigation plan and conducting a study on additional 
alternatives, NOAA has taken positive steps towards establishing a 
contingency plan for handling the potential impact of satellite data gaps in 
the afternoon polar orbit. However, NOAA does not yet have a 
comprehensive contingency plan because it has not yet selected the 
strategies to be implemented, or established procedures and actions to 
implement the selected strategies. In addition, there are shortfalls in the 
agency’s current plans as compared to government and industry best 
practices, such as not always identifying specific actions with defined 
roles and responsibilities, timelines, and triggers. Moreover, multiple 
steps remain in testing, validating, and implementing the contingency 
plan. The following table provides an assessment of the extent to which 
NOAA’s mitigation plan met contingency planning practices in three 
general categories. 
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Table 11: Assessment of NOAA's Gap Mitigation Plan for its Polar Environmental Satellites 


Contingency % 

planning!; 

category assessment Description 

The plan identifies key scenarios, such as an earlier than expected loss of data from the S-NPP 
satellite, a slip in the JPSS-1 launch date, a failure of JPSS-1 on launch, and a longer than 
expected calibration and validation period for JPSS-1. 

The plan includes analyses of the impact to users from losing key weather products from ATMS, 
CrSS, and VIIRS. The plan also identifies minimum performance outputs for key weather data and 
reflects the top priorities identified in JPSS program requirements. 

However, the plan does not address other scenarios, including the possibility of a loss of data 
from Department of Defense and European partner satellites in morning orbits or a partner 
mission in the afternoon orbit. 

Further, the plan does not include recovery time objectives for key data products. 

Developing Partially met • The plan describes the impact of potential gaps in polar afternoon satellite data, identifies 
contingency alternative strategies for mitigating the gap, and lists technical, programmatic, and management 

plans actions needed to implement gap mitigation strategies. 

• However, the plan has not yet been integrated with the other alternatives that were subsequently 
identified. 

« NOAA has not yet assessed its alternative strategies based on costs, benefits, and potential 
impacts. 

• The plan does not identify options for preventing gaps from occurring. 

• The plan does not identify opportunities for accelerating the calibration and validation phase— the 
time between launch and availability of operational products— on JPSS-1. 

• The plan does not identify specific actions for executing two of the five alternatives; identify roles 
and responsibilities for three alternatives; identify timelines for any of the alternatives; or identify 
triggers to signal when steps should be taken on any of the alternatives. 

Validating and Not met • NOAA has not yet initiated efforts to validate or implement its gap mitigation plan. 

implementing 

contingency 

plans 

Source; GAO analysis ol NOAA data. 


Identifying Partially met 
failure 

scenarios and 
impacts 



NOAA officials stated that the agency is continuing to work on 
refinements to its gap mitigation plan, and that they anticipate issuing an 
updated plan in fall 2013 that will reflect additional alternatives. While 
NOAA expects to update its plan, the agency does not yet have a 
schedule for adding key elements — such as specific actions, roles and 
responsibilities, timelines, and triggers — -for each alternative. Until NOAA 
establishes a comprehensive contingency plan that integrates its 
strategies and addresses the elements identified above to improve its 
plans, it may not be sufficiently prepared to mitigate potential gaps in 
polar satellite coverage. 
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Conclusions 


While NOAA has made noteworthy progress over the past year in utilizing 
S-NPP data in weather forecasts and developing instrument and 
spacecraft components of the JPSS-1 satellite, the agency is facing 
challenges in its efforts to ensure sustained satellite observations. 
Specifically, NOAA does not expect to validate Key S-NPP products until 
September 2014 — nearly 3 years after the satellite’s launch. Also, the 
agency does not track the usage of its satellite products or obtain 
feedback on them, which limits the program’s ability to ensure that 
satellite products are useful. Further, the program experienced scheduling 
problems on its ground systems, which led to a delay in planned system 
upgrades. Until NOAA establishes a way to track which agencies are 
using its products and to obtain feedback on those products, the program 
office may continue to experience delays in delivering actionable S-NPP 
data to users. 

Almost 3 years after the JPSS program was established, it lacks a 
complete integrated master schedule. While program officials recently 
established a preliminary integrated master schedule, the schedule lacks 
proper linkage among dependent activities, which limits its ability to 
calculate dates and predict changes in the future. Further, the quality of 
component schedules varied for certain practices. These issues raise 
questions about the program’s 70 percent joint cost and schedule 
confidence level in the JPSS-1 launch date. Until the program office 
develops a complete integrated schedule and addresses weaknesses in 
component schedules, it will lack the information needed to effectively 
monitor development progress and ensure the planned JPSS-1 launch 
date. 

NOAA has taken steps to mitigate an anticipated gap in polar afternoon 
satellite data, but its efforts are incomplete. Specifically, the agency has 
not yet established a comprehensive contingency plan that identifies 
specific actions with defined roles and responsibilities, timelines, and 
triggers for contingency strategies. Moreover, the agency’s recent 
assessment of a larger set of alternatives has not yet been integrated with 
its mitigation plans. As a result, the agency faces important decisions as 
to whether and how the various alternatives should be carried out. While 
NOAA plans to add alternatives to its mitigation plan by fall 2013, it does 
not yet have plans to add the other key components. Until NOAA 
establishes a comprehensive contingency plan that addresses these 
shortfalls, its plan for mitigating potential gaps in the polar orbit may not 
be effective in avoiding significant impacts to NOAA’s weather mission. 
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l?pmmmpnHnrirm«i for Given importance of having reliable schedules for managing JPSS 

satellite launch dates and the significance of polar-orbiting satellite data to 
Executive Action weather forecasts, we recommend that the Secretary of Commerce direct 

the Administrator of NOAA to 

• track the extent to which key groups of satellite data users are using 
S-NPP and JPSS products, and obtain feedback on these products; 

• establish a complete JPSS program integrated master schedule that 
includes a logically linked sequence of activities; 

• address the shortfalls in the ground system and spacecraft 
component schedules outlined in this report; 

• after completing the integrated master schedule and addressing 
shortfalls in component schedules, update the joint cost and schedule 
confidence level for JPSS-1 , if warranted and justified; 

• establish a comprehensive contingency plan for potential satellite data 
gaps in the polar orbit that is consistent with contingency planning 
best practices identified in this report. The plan should include, for 
example, specific contingency actions with defined roles and 
responsibilities, timelines, and triggers; analysis of the impact of lost 
data from the morning orbits; and identification of opportunities to 
accelerate the calibration and validation phase of JPSS-1 . 


Agency Comments 


We sought comments on a draft of our report from the Department of 
Commerce and NASA. We received written comments from Commerce 
transmitting NOAA’s comments. NOAA concurred with all five of our 
recommendations and identified steps that it is taking to implement them. 
It also provided technical comments, which we have incorporated into our 
report, as appropriate. NOAA’s comments are reprinted in appendix IV. 

NASA did not provide comments on the report’s findings or 
recommendations, but noted that it would provide any input it might have 
to NOAA for inclusion in NOAA’s comments. 


As agreed with your office, unless you publicly announce the contents of 
this report earlier, we plan no further distribution of it until 30 days from 
the date of this letter. We are sending copies of this report to interested 
congressional committees, the Secretary of Commerce, the Administrator 
of NASA, the Director of the Office of Management and Budget, and other 
interested parties. In addition, this report will be available on the GAO 
Web site at http;//www.gao.gov. 
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If you or your staff have any questions on the matters discussed in this 
report, please contact me at (202) 512-9286 or at pownerd@gao.gov. 
Contact points for our Offices of Congressional Relations and Public 
Affairs may be found on the last page of this report. GAO staff who made 
major contributions to this report are listed in appendix V. 

a. 

David A. Powner 
Director, Information Technology 
Management Issues 
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Appendix I: Objectives, Scope, and 
Methodology 


Our objectives were to (1) evaluate the National Oceanic and 
Atmospheric Administration’s (NOAA) progress in meeting the Joint Polar 
Satellite System (JPSS) program’s objectives of sustaining the continuity 
of NOAA’s polar-orbiting satellite system through the Suomi National 
Polar-orbiting Partnership (S-NPP) and JPSS satellites, (2) evaluate the 
quality of the JPSS program schedule, and (3) assess NOAA's plans to 
address potential gaps in polar satellite data. 

To evaluate NOAA's progress in meeting JPSS program objectives, we 
assessed (1) the status of activities supporting the operational S-NPP 
satellite, (2) progress on efforts to develop the JPSS-1 satellite, and (3) 
recent changes in JPSS program scope. A more detailed description of 
our activities in each of these areas follows. 

• S-NPP progress: We reviewed monthly program reports to identify 
the status of key upgrades to the ground system supporting S-NPP 
and the efforts to transition operational control of the satellite to 
NOAA. In addition, we compared the program’s current estimated 
completion dates for S-NPP products to original program estimates for 
when the products would be available for operational use. We 
compared program office information on the extent to which S-NPP 
products were being used to best practices in evaluating the use of 
completed products. We also interviewed program officials about 
algorithm maturity and the extent to which users are using S-NPP 
products. 

- JPSS-1 progress: We analyzed plans and reports on system 

development efforts for the JPSS-1 satellite. Specifically, we reviewed 
the JPSS-1 mission preliminary design review package to assess 
completion of work on the instruments, spacecraft, and ground system 
as well as cost, schedule, and technical performance for the JPSS-1 
satellite. We also examined JPSS program office monthly status 
reports on system development progress to identify variances and 
corrective actions being taken to address the most critical issues and 
risks to the program. We interviewed JPSS program officials to 
discuss system development status. We assessed the reliability of 
reported milestone dates for top-level milestones by examining 
multiple project status reports at different points in time for consistent 
reporting of dates or explanations of any changes and compared 
reported dates to source schedule data. We determined that the 
milestone data were sufficiently reliable for our reporting purposes. 

• Changes in JPSS program ■scope: We compared the program’s 
requirements as of September 201 1 to the program’s updated plans 
and requirements as of May 2013 to identify key changes and to 
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Appendix i: Objectives, Scope, and 
Methodology 


assess whether changes in capabilities have impacted program goals 
and objectives. We interviewed program officials about changes in the 
JPSS program’s scope. We assessed the reliability of the program’s 
estimated savings from program scope changes by comparing them 
to program documentation on prior and current cost estimates and 
found that the estimates were sufficient for our purposes. 

To evaluate the quality of NOAA's program schedule, we used an 
exposure draft of GAO’s Schedule Assessment Guide 1 to assess 
schedule management practices and characteristics of selected 
contractor schedules. We selected and analyzed three component 
contractor schedules — the ground system, the spacecraft, and the 
Visible/Infrared Imager/Radiometer Suite instrument — because these 
schedules represented the critical path for flight and the entire ground 
system development schedule that was either already or likely to be 
driving the JPSS-t satellite launch date. We also analyzed schedule 
metrics as a part of that analysis to highlight potential areas of strengths 
and weakness in, among other things, schedule logic, use of resources, 
task duration, float, and task completion. In order to assess each 
schedule against the ten best practices, we traced and verified underlying 
support and determined whether the program office or contractor 
provided a small portion, about half, a large portion, or complete evidence 
that satisfied the criterion and assigned a score depicting that the 
practices were met, minimally met, partially met, substantially met, or fully 
met By examining the schedules against our guidance, we conducted a 
reliability assessment on each of the schedules and incorporated our 
findings on reliability limitations in the analysis of each component 
schedule. We reviewed documentation on a schedule risk assessment 
the JPSS program office conducted on JPSS-1 flight project schedules to 
identify assumptions and results of its analysis and to assess the 
reliability of the reported JPSS joint cost and schedule confidence level. 
We interviewed government and contractor officials to discuss reasons for 
observed shortfalls in schedule management practices. We determined 
that the schedules were sufficiently reliable for our reporting purposes 
and our report notes the instances where reliability concerns affect the 
quality of the schedules as well as the program’s schedule risk 
assessment. 


1 GAO Schedule Assessment Guide: Best Practices for Project Schedules, GAO-12-12QG 
(exposure draft) (Washington, D.C.: May 30, 2012). 
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Appendix i: Objectives, Scope, and 
Methodology 


To assess plans to address potential gaps in polar satellite data, we 
reviewed NOAA’s October 2012 polar satellite gap mitigation plan and a 
subsequent technical assessment as well as NOAA's plans for 
implementing recommendations from the assessment. We compared 
elements of the plan and assessment against best practices developed 
from leading government and industry sources such as the National 
Institute of Standards and Technology, the Software Engineering 
Institute’s Capability Maturity Model® Integration, and our prior report, 
Based on that analysis, we identified shortfalls in NOAA’s current plans 
as well as key remaining activities for the agency to accomplish. We 
interviewed NOAA headquarters staff and JPSS program officials about 
the technical assessment and their plans. 

We performed our work at NASA and NOAA offices in the Washington, 
D.C. area. We conducted this performance audit from October 2012 
through September 2013 in accordance with generally accepted 
government auditing standards. Those standards require that we plan 
and perform the audit to obtain sufficient, appropriate evidence to provide 
a reasonable basis for our findings and conclusions based on our audit 
objectives. We believe that the evidence obtained provides a reasonable 
basis for our findings and conclusions based on our audit objectives. 
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Appendix II: NOAA Plans to Transfer 
Selected JPSS Program Components to the 
Polar Free Flyer Program 


In order to reduce Joint Polar Satellite System (JPSS) program costs and 
increase the program’s focus on its weather mission, the National 
Oceanic and Atmospheric Administration (NOAA) plans to transfer key 
program components to a separate program, called the Polar Free Flyer 
program. After establishing JPSS in 2010, NOAA committed to 
developing three units of the Total and Spectral Solar Irradiance Sensor 
(TSIS) and to finding a spacecraft and launch accommodation for three 
instruments that would not be on the JPSS satellite: TSIS, the Advanced 
Data Collection System (A-DCS), and the Search and Rescue Satellite- 
Aided Tracking (SARSAT) system. As of June 2012, the JPSS program 
planned to launch two stand-alone satellites (called free flyers) to 
accommodate two suites of these instruments. However, NOAA recently 
made several decisions that affect these commitments, and expects to 
finalize these plans by the end of September 2013: 

• NOAA plans to transfer responsibility for developing TSIS and 
accommodating the launch of the three instruments out of the JPSS 
program and into a newly established Polar Free Flyer program. 
According to JPSS program officials, a transition plan for the new 
program is under review and selected staff positions have been filled. 

• The Polar Free Flyer program will deliver a single free flyer mission 
instead of the two missions planned under the JPSS program. 

- NOAA will transfer the responsibility for developing the second TSIS 
instrument to the National Aeronautics and Space Administration 
(NASA), rely on an Air Force Global Positioning System mission to 
continue SARSAT coverage, and find a launch vehicle to 
accommodate an additional A-DCS instrument. 

• NOAA plans to use the JPSS ground system to support the Polar 
Free Flyer Program. 

The JPSS program plans to award a contract in fiscal year 2014 for a 
spacecraft that is to accommodate the TSIS, A-DCS, and SARSAT 
instruments. The three instruments are in development and testing, and 
are expected to be delivered to the satellite by 2015. The planned launch 
readiness date for the free-flyer mission was originally July 2016, but that 
date may change pending the outcome of the spacecraft contract award. 
Also, the program is looking to share a launch vehicle with some other 
mission to reduce launch costs. However, the program office is not aware 
of any ride-sharing opportunities that could accommodate the mission’s 
planned launch readiness date. 
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Appendix III: Assessment of JPSS 
Component Schedules Implementation of 
Best Practices in Scheduling 


The following tables identify detailed assessments of the extent to which 
three component schedules supporting the JPSS-1 schedule met the ten 
best practices and four characteristics of a high-quality, reliable schedule. 
Table 12 provides an assessment of the ground system contractor's 
schedule, which integrates activities from seven components of the 
ground system; table 13 provides an assessment of the spacecraft 
contractor’s detailed schedule; and table 14 provides an assessment of 
the VIIRS contractor’s detailed schedule. 

The following information describes the key that we used in tables 12 
through 14 to convey the results of our assessment of the schedules’ 
consistency with an exposure draft of GAO best practices for schedule 
management. 1 

• Met: The program office or contractor provided complete evidence that satisfies the entire 
criterion. 

® Substantially met: The program office or contractor provided evidence that satisfies a targe portion 
of the criterion. 

O Partially met: The program office or contractor provided evidence that satisfies about half of the 
criterion. 

<3 Minimally met: The program office or contractor provided evidence that satisfies a small portion of 
the criterion. 

O Not met: The program office or contractor provided no evidence that satisfies any of the criterion. 


Table 12: Detailed Assessment of Ground System Schedule Quality 

Schedule characterfsticor 

best practice 

)• „ v \ . <. ... i . .| .• 




Capturing all activities 

« 

The schedule largely reflects the statement of work. However, the schedule only partially 
reflects the work breakdown structure and includes 40 activities that are marked as both 
summary activities and milestones. 

Assigning resources to all 
activities 

» 

The contractor has established a clear process for integrating information between the 
schedule and the resource management software. However, resource leveling has been 
performed outside of the schedule, which limits the effectiveness of the process. 

Establishing the duration of 
ail activities 

9 

According to the contractor, durations were estimated by the people responsible for the 
activities based on work to be done. Additionally, calendars were used to specify valid 
working times for all activities. However, over 35 percent of the activities in the schedule 
were of long duration, and only half of these were justified in schedule documentation. 


1 GAO Schedule Assessment Guide: Best Practices for Project Schedules , GAO-12-120G 
(exposure draft) (Washington, D.C.: May 30, 2012). 
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Appendix III: Assessment of JPSS Component 

Schedules Implementation of Best Practices in 

Scheduling 

■Mug 

GAO 

assessment Examples of strengths and weaknesses 

Well-constructed 

Sequencing all activities 

a 

A majority of the activities in the schedule had dependencies, and the schedule's 
relationships were largely finish-to-start However, program officials did not justify in 
schedule documentation the small number of activities with missing dependencies, date 
constraints, and lags. 

Confirming that the critical 
path is valid 

(5 

The critical path and driving path are not fully valid because they are not free of long 
activities, constraints, and lags. Moreover, considering the schedule as a whole, the 
schedule software may not be calculating the true critical path of the project because the 
use of more than 800 constraints. These may result in float values that present an 
unrealistic view of the critical path. 

Ensuring reasonable total 
float 

3 

According to contractor officials, float values have been assessed as part of regularly 
scheduled health checks and they have determined that for certain cases float values 
are necessarily high. However, not all float values calculated by the schedule are 
reasonable and many values do not accurately reflect true schedule flexibility. 

Additionally, the JPSS program office did not provide a documented assessment of total 
float values that appear to be excessive to show that the team agrees with the logic and 
that the float is consistent with the plan. 

Credible .4^ 

Verifying that the schedule 
can be traced horizontally 
and vertically 

3 

The schedule is vertically traceable in all but one of the milestones that we reviewed, 
meaning that it allows activity owners to trace activities to higher-level milestones with 
intermediate and summary schedules. However, the schedule is not fully horizontally 
traceable— that is, although the schedule includes giver/receiver milestones that are 
defined in the schedule documentation, the schedule was not always affected by 
activities whose durations were extended by hundreds of days. 

Conducting a schedule risk 
analysis 

© 

The contractor conducted a schedule risk analysis with a schedule network that partially 
meets the characteristics associated with a good schedule network, as well three point 
duration estimates that were captured from control account managers. However, the 
analysis was conducted for select near-term milestones— not to the readiness of the 
ground system for the launch of JPSS-1. Additionally, the analysis did not include risks 
most likely to delay the project, the paths or activities that are most likely to delay the 
project, and the activities that most often ended up on the critical path. 

Controlled '■■■ ■ 



Updating the schedule using 
actual progress and logic 

3 

Responsibility for changing the schedule has been assigned to someone who has the 
proper training and experience in critical path method scheduling and the schedule is 
free of clearly erroneous progress information. However, although the contractor 
provides a monthly program management briefing that addresses the status of externa! 
giver/receiver activities, it does not address the status of key milestone dates, changes 
in network logic, or critical paths. 

Maintaining a baseline 
schedule 

3 

A baseline schedule exists and is compared to the current schedule to track variances 
from the plan. According to contractor officials, a formal change control process is used 
to make changes to the baseline. However, the contractor's rolling wave reports do not 
satisfy all elements of a baseline schedule document. A baseline schedule document is 
a single document that describes, among other things, the organization of the IMS; the 
logic of the network; the basic approach to managing resources; the schedule's unique 
features; and justification for lags, date constraints, and long activity durations. 


Source: GAO analysis of JPSS program office and conlraclor schedule data. 
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Appendix 111: Assessment of JPSS Component 

Schedules Implementation of Best Practices in 

Scheduling 

Table 13: Detailed Assessment of Spacecraft Schedule Quality 

r-T- ■■■■■ 


■1 ■ ■ 

CaKpst&rasa&B 





are mapped to the contract data requirements list and contractor work breakdown 
structure numbers. The schedule contains a low level of detail, which reflects the 
contractor’s role as integrator for multiple vendors in a fixed-price environment. 

However, with a nearly 1:1 ratio of detail activities to milestones, the schedule would 
benefit from increased detail into work activities. 

Assigning resources to all 
activities 


The contractor has established a clear process for integrating information between the 
schedule and the resource management software. However, resource leveling has been 
performed outside of the schedule, which limits the effectiveness of the process. 

Establishing the duration of 
all activities 

a 

The contractor has experience in developing spacecraft similar to JPSS-1, including 
S-NPP. Contractor officials stated that they obtained duration estimates for activities 
from engineers that were responsible for them while other engineers conducted peer 
reviews on those estimates. However, durations in general appear too long to facilitate 
objective measurement of accomplished effort Even accounting for procurement-related 
activities and level-of-effort type recurring meeting activities, one-third of alt remaining 
activities are longer than 2 business months. 

Well-constructed ••• 

Sequencing all activities 

o 

The schedule was partially logically sequenced. Approximately 20 percent of all 
remaining activities and milestones were missing predecessor links, successor links or 
both. Officials stated that many of these activities were related to contract data 
requirements list deliveries and internal or external handoffs (called givers/receivers). 

We found other areas of questionable sequencing logic. For instance, there are about 10 
percent of remaining activities in the schedule that have lags and leads, including some 
instances of leads with start-to-finish logic— a particularly abnormal logical relationship. 

We also found date constraints pervasive throughout the schedule: 140 activities have 
soft constraints and 17 have hard constraints. Hard constraints are useful for calculating 
the amount of float available in the schedule and, therefore, the realism of the required 
project finish date and available resources during schedule development. However, they 
may be abused if they force activities to occur on specific dates that are determined off- 
line without much regard for the realism of the assumptions necessary to achieve them. 

Confirming that the critical 
path is valid 

9 

The schedule defines activities with zero total float as critical. However, partly because 
of logic issues, the critical path as calculated by the scheduling software was convoluted 
and most likely unreliable. The path includes lags, leads, long-duration activities, and 
activities with hard constraints, which by definition will appear as critical. Officials stated 
they agreed that software-calcutated critical paths cannot be relied upon in a complex 
schedule, and said they report the longest (or driving path) to management. Ideally, the 
critical path and the longest path should be the same, but our analysis found the longest 
path to be somewhat different than the default critical path; it does not include several 
activities that appeared on the critical path because of their date constraints. In addition, 
the longest path also includes several near-term, non procurement-related activities with 
long durations, spanning between 84 and 365 days. 
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Appendix HI: Assessment of JPSS Component 

Schedules Implementation of Best Practices in 

Scheduling 

4 *• Juris .. 

GAO 

assessment Examples of strengths and weaknesses 

Ensuring reasonable total 
float 

a 

Officials stated that the total float values calculated by the schedule accurately reflect 
true schedule flexibility. However, we found that the schedule appears overly flexible 
due to high amounts of total float. 70 percent of remaining activities and milestones have 
greater than 30 days (about 5 business weeks) of total float. This includes 67 activities 
(8 percent of remaining) with over 1,000 days of float, meaning these activities can slip 
more than 3.5 business years before impacting the planned finish date of the project. 
Without documented justification for high float values in the schedule, it is not dear 
which are explained by milestones without successors, which are due to schedule 
maintenance, and which are due to incomplete logic. 

Credible ftp.: 


• ..... " ”' x '' ' 

Verifying that the schedule 
can be traced horizontally 
and vertically 

a 

The schedule is vertically traceable, with dates in the detail schedule mapping to higher- 
level management briefing charts. The schedule is generally horizontally traceable. The 
schedule dearly identifies givers and receivers and negative total float calculations 
respond appropriately when significant delays are introduced into the network. However, 
negative float is calculated because key milestones are constrained. While the negative 
float may be an accurate assessment of potential delay, management may not be aware 
of potential delays when constrained dates are reported in summary-level schedules. 

Conducting a schedule risk 
analysis 

o 

Officials stated that they follow an internal process to perform schedule risk analyses on 
the schedule. Officials also stated that three-point durations are applied to activities, 
correlation is accounted for, and a Monte Carlo analysis is run on the schedule to derive 
probabilities for forecasted dates. Although the contractor has no contractual 
requirement to share schedule risk analysis results with the JPSS program office, it 
provided a summary of its risk assessment report and instructions. However, this 
summary information did not include supporting details such as risk data inputs and data 
normalization techniques and the contractor did not incorporate correlation or perform 
the schedule risk analysis on a logically sound (well-constructed) schedule. 

Controlled 

Updating the schedule using 
actual progress and logic 

9 

Schedule progress is updated monthly and the schedule is delivered to the JPSS 
program office in accordance with contractual requirements. While a formal schedule 
narrative does not accompany the schedule delivery to the government, much of the 
narrative information — such as the status of key milestones and handoffs, explanations 
for changes in key dates, and an overview of critical and near-critical paths — is 
conveyed in monthly management meetings. However, 26 activities had start or finish 
dates in the past. Of these, 12 activities could be explained by obsolete scope of work. 

We also found 12 out-of-sequence activities, representing 13 percent of in-progress 
activities. 

Maintaining a baseline 
schedule 

o 

Contractor officials stated that they maintain schedule baseline information in the default 
baseline fields in the schedule and we found that baseline dates were set in the 
schedule. However, a schedule baseline document was not created for the schedule 
baseline. We found 104 activities in the schedule without baseline dates, 72 of which are 
complete or are planned to start by 2014. The majority of start variances appear 
reasonable, but we did find start variances ranging from -221 days (221 days ahead of 
schedule) to 237 days (237 days delayed). Despite the significant variances noted, it is 
commendable that the schedule includes baseline information that allows for analysis 
and monitoring of dates' variances. 


Source: GAO analysis of JPSS program office and cornraclor schethie data. 


GAO-13-676 Polar-orbiting Environmental Satellites 




226 


Appendix ill: Assessment of JPSS Component 

Schedules Implementation of Best Practices in 

Scheduling 

Table 14: Detailed Assessment of VIIRS Schedule Quality 

Schedule characteristic or - 
best practice "V' 

,;GAO 

merit Examples of strengths and weaknesses , ; j 

Comprehensive 



Capturing all activities 

it 

The schedule largely reflects the work breakdown structure and statement of work 
However, the schedule does not reflect work to be performed by a subcontractor and 
includes 10 activities that are marked as both summary activities and milestones. 

Assigning resources to all 
activities 

a 

The contractor has established a clear process for integrating information between the 
schedule and the resource management software. However, resource leveling has been 
performed outside of the schedule, which limits the effectiveness of the process. 

Establishing the duration of 
aii activities 

• 

According to the contractor, durations were estimated by the people responsible for the 
activities based on work to be done, realistic assumptions about available resources, 
productivity, normal interferences and distractions, and reliance on others. Further, the 
contractor justified in its schedule documentation virtually all activities with durations 
longer than 44 days. 

Well-constructed 

Sequencing all activities 

a 

All but one activity in the schedule has at least one predecessor and one successor, and 
that activity was justified in the schedule documentation. Additionally, every schedule 
date constraint was justified in schedule documentation. However, the schedule has a 
very small number of activities with dangling logic. Further, although explanations were 
provided for most of the small number of lags, the explanations did not justify their use. 

Confirming that the critical 
path is valid 

a 

Program office and contractor officials use the driving path to manage the program, 
which is preferred because it represents the activities that are driving the sequence of 
start dates directly affecting the estimated finish date. However, the driving path and the 
critical path to key milestones should be the same, and they are not. Also, the critical 
path is not valid because it contains level of effort activities. 

Ensuring reasonable total 
float 

a 

The program office has defined reasonable float values, and the values associated with 
the schedule largely fit that definition. For those float values that were not reasonable, 
the program office provided a documented assessment of those values to show that the 
team agrees with the logic and that the float is consistent with the plan. However, the 
schedule has a small number of activities that have unrealistic float values. 

Credible 


. , ' ' ' - ' 

Verifying that the schedule 
can be traced horizontally 
and vertically 

£ 

The schedule is largely horizontally traceable. In particular, the schedule is affected by 
activities whose durations are extended by hundreds of days, and it includes 
giver/receiver milestones that represent handoffs between contractor integrated project 
teams. However, the schedule does not include all givers/receivers between the 
contractor and the program office. Additionally, the schedule is vertically traceable. 
Specifically, it allows activity owners to trace activities to higher-level milestones with 
intermediate and summary schedules. 

Conducting a schedule risk 
analysis 

3 

A schedule risk analysis was conducted with a good schedule network, and three point 
duration estimates that were captured from subject matter experts. However, the 
duration estimates did not reflect risks from the project's risk register and the analysis 
was focused on only the deterministic critical path and near-critical path. 
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Appendix III: Assessment of JPSS Component 

Schedules Implementation of Best Practices in 

Scheduling 

Schedule characteristic or 
best practice 

GAO 

assessment Examples of strengths and weaknesses 

Controlled 



Updating the schedule using 
actual progress and logic 

• 

Responsibility for changing or updating the schedule has been assigned to someone 
who has the proper training and experience in critical path method scheduling. 

Additionally, the schedule is free of clearly erroneous progress information. Further, the 
contractor provides a schedule narrative accompanying each status update, which 
describes the status of key milestone dates (including the program finish date); 
explanations for changes in key dates; and a description of the critical paths. 

Maintaining a baseline 
schedule 

9 

A baseline schedule exists and is compared to the current schedule to track variances. 
However, the contractor did not have a baseline schedule document. A baseline 
schedule document is a single document that describes, among other things, the 
organization of the IMS; the logic of the network; the basic approach to managing 
resources; the schedule’s unique features; and justification for lags, date constraints, 
and long activity durations. 


Source GAO analysis of JPSS program office and contractor schedule data. 
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Appendix IV: Comments from the 
Department of Commerce 



THE DEPUTY SECRETARY OF COMMERCE 

Washington. D.C. 20230 


August 26,2013 


Mr. David A. Powner 
Director 

Information Technology Management Issues 
U.S. Government Accountability Office 
441 G Street NW 
Washington. DC 2054B 

Dear Mr. Powner: 

Thank you for the opportunity to review and comment on the Government Accountability 
Office (GAO) draft report entitled'?olar Weather Satellites: NOAA Identified Ways to Mitigate 
Data Gaps, but Contingency Plans and Schedules Require Further Attentioif (GAO-13-676). On 
behalf of the Department of Commerce, I have enclosed the National Oceanic and Atmospheric 
Administratiorfs programmatic comments to the draft report. At your request, we are conducting 
a sensitivity review and will notify you of the results when our review is complete. 

If you have any questions, please contact me or Margaret Cummisky, Assistant Secretary 
for Legislative and Intergovernmental Affairs at (202) 482-3663. 



Patrick Gallagher 

Acting Deputy Secretary of Commerce 


Enclosure 
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Appendix IV: Comments from the Department 
of Commerce 


Department of Commerce 

National Oceanic and Atmospheric Administration Response to 
GAO Draft Report “Polar Weather Satellites - NOAA Identified 
Ways to Mitigate Data Gaps, but Contingency Plans 
and Schedules Require Further Attention” 
(GAO-13-676) 


The Department of Commerce’s National Oceanic and Atmospheric Administration (NOAA) 
appreciates the opportunity to review the Government Accountability Office (GAO) draft report 
on Polar Weather Satellites. The draft report on Polar Weather Satellites product development, 
program schedule, and potential gaps does a fair job of assessing the state of the program. Given 
the history and changes in the polar-orbiting operational environment satellite programs over the 
past NOAA recommends the following changes and updates to the report to ensure that 

the information presented is complete, up-to-date, and reflects current plans. 

NOAA Response to GAO Recommendations 

The draft OAO report states "Given the importance of having reliable schedules for managing 
JPSS satellite launch dales and the significance of polar-orbiting satellite data to weather 
forecasts, we recommend the Secretary of Commerce direct the Administrator of NOAA to” — 

Recommendation 1: “Track the extent to which groups of satellite data users are using S-NPP 
and JPSS products and obtain feedback on these products." 

NOAA Response: NOAA agrees with this recommendation. NOAA 1* already tracking the use 
of S-NPP products by key user groups such as the NWS/NCEP. For example, NOAA uses the 
Joint Center for Satellite Data Assimilation (JCSDA) to assess the impacts of new data sources 
on Numerical Weather Predication. NOAA also utilizes existing partner forums to receive 
feedback from non-NOAA users such as EUMETSAT and DoD. NOAA will expand its 
tracking to include all S-NPP and JPSS products used by NOAA programs and partner 
organizations. 

Recommendation 2: "establish a complete JPSS program integrated master schedule that 
includes a logically linked sequence of activities;” 

NOAA Response: NOAA agrees with this recommendation. NOAA could not complete two 
parts of the Integrated Master Schedule (IMS) by the time or the System Definition Review 
(SDR) due to contracting efforts underway but not completed. However, risk was mitigated by 
including the preliminary schedules and having an acceptable plan for closure. The IMS will be 
completed by January 2014 when contractual modifications required to support the ground 
segment have been finalized. Nevertheless, the JPSS program has made tremendous progress on 
maturing it* schedule and has confidence in It. This is supported by independent review results 
of the SDR and the confirmation of the JPSS performance baseline (indicated by completing the 
Key Decision Point-I) by the Acting Deputy Secretary of Commerce. 
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Appendix IV: Comments from the Department 
of Commerce 


Recommendation 3: "address the shortfalls in the ground system and spacecraft component 
schedules outlined in this report;’' 

NOAA Response: NOAA agrees with this recommendation. NOAA wilt address this 
recommendation by updating the ground system and spacecraft component schedules based on 
the recent completion of its SRR and K.DP-I reviews. In addition, we will continue to monitor 
and analyze these schedules on a monthly basis. 

Recommendation 4: "after completing the integrated master schedule and addressing shortfalls 
in component schedules, update the joint cost and schedule confidence level for JPSS-1, if 
warranted and justified;" 

NOAA Response: NOAA agrees with this recommendation. NOAA will update the JPSS- 1 
joint cost and schedule confidence levels after completing the IMS. if warranted and justified. 

Recommendation 5: “establish a comprehensive contingency plan for potential satellite data 
gaps in the potar orbit that is consistent with the contingency planning best practices identified in 
this report. The plan should include, for example, specific contingency actions with defined 
roles and responsibilities, timelines, and triggers; analysis of the impact of lost data from the 
morning orbits, and identification of opportunities to accelerate the calibration and validation 
phases of JPSS- 1." 

NOAA Response: NOAA agrees with this recommendation. NOAA acknowledges the need to 
develop a more comprehensive contingency plan for polar-orbiting satellite data gaps, including 
gaps in che early and mid-moming orbits. NOAA plans to update the current Gap Mitigation 
Plan in the fall of 2013 and continue to update the plan approximately every 6 months. This 
update will include a first iteration addressing items identified in the recommendation. 

Contingency actions are of two categories: (I) those which may be taken to decrease the 
probability of a gap occurring once a triggering event occurs (or decreasing the duration of a gap 
that occurs), and (2) those mitigating the impact of a gap once a triggering event occurs. It 
should be noted that for applications such as numerical weather prediction modeling, the 
methods of mitigating the impact of a gap include improving theNWP models themselves, 
improving the data assimilation system to optimize the impact of the data used in the model, and 
developing means of increasing the fraction of available data assimilated, for example using 
satellite data that are affected by clouds and precipitation. These methods would be the same no 
matter which gap or combination of gaps might occur — early, mid-moming, or afternoon. Hence 
the usefulness of assessing the impact of gaps in each orbit is limited. Moreover, efforts to 
quantify each gap impact will compete for resources with efforts that would limit the impact of 
any of the potential gaps. Therefore, our plan must be judicious in applying resources. 
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